-- Logs begin at Wed 2022-02-16 17:25:22 UTC, end at Wed 2022-02-16 18:39:50 UTC. -- Feb 16 17:59:40.858523 dv-cinder-773985-33-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 16 17:59:40.868331 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 16 17:59:40.871369 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 17:59:40 2022] *** Feb 16 17:59:40.871690 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 17:59:40.871870 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 17:59:40.872035 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: nodename: dv-cinder-773985-33-iscsi Feb 16 17:59:40.872208 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: machine: x86_64 Feb 16 17:59:40.872360 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: clock source: unix Feb 16 17:59:40.872469 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: pcre jit disabled Feb 16 17:59:40.872573 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: detected number of CPU cores: 4 Feb 16 17:59:40.872676 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: current working directory: / Feb 16 17:59:40.872809 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: detected binary path: /usr/bin/uwsgi-core Feb 16 17:59:40.872961 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: your processes number limit is 47680 Feb 16 17:59:40.873064 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: your memory page size is 4096 bytes Feb 16 17:59:40.873208 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: detected max file descriptor number: 2048 Feb 16 17:59:40.873316 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: lock engine: pthread robust mutexes Feb 16 17:59:40.873610 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: thunder lock: enabled Feb 16 17:59:40.874012 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 16 17:59:40.874214 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 17:59:40.923457 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: Python main interpreter initialized at 0x55dfa65e59c0 Feb 16 17:59:40.923457 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: python threads support enabled Feb 16 17:59:40.923457 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: your server socket listen backlog is limited to 100 connections Feb 16 17:59:40.923457 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: your mercy for graceful operations on workers is 90 seconds Feb 16 17:59:40.923849 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 17:59:40.923936 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: *** Operational MODE: preforking *** Feb 16 17:59:40.924164 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: *** uWSGI is running in multiple interpreter mode *** Feb 16 17:59:40.924164 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: spawned uWSGI master process (pid: 79621) Feb 16 17:59:40.924378 dv-cinder-773985-33-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 16 17:59:40.925528 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: spawned uWSGI worker 1 (pid: 79635, cores: 1) Feb 16 17:59:40.925887 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: spawned uWSGI worker 2 (pid: 79636, cores: 1) Feb 16 17:59:40.926970 dv-cinder-773985-33-iscsi devstack@keystone.service[79621]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 17:59:46.975172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 17:59:46.975172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: from cryptography.utils import int_from_bytes Feb 16 17:59:46.976004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 17:59:46.976004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: from cryptography.utils import int_from_bytes Feb 16 17:59:46.976161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 17:59:46.976161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: from cryptography.utils import int_from_bytes Feb 16 17:59:46.976673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 17:59:46.976673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: from cryptography.utils import int_from_bytes Feb 16 17:59:47.022762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 17:59:47.027935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 17:59:47.027935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 17:59:47.028113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 17:59:47.028113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] command line args: [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 17:59:47.028234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] command line args: [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 17:59:47.028303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 17:59:47.028368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 17:59:47.028431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ================================================================================ {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 17:59:47.028498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ================================================================================ {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 17:59:47.028562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] admin_token = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.028625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] admin_token = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.028625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] config_dir = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.028742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] config_dir = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.028805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.028868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.028926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] config_source = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.028985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] config_source = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] debug = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] debug = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.029994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] list_limit = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] list_limit = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] log_config_append = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] log_config_append = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030442 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] log_dir = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] log_dir = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] log_file = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] log_file = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.030978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.031982 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] publish_errors = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] publish_errors = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.032928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] standard_threads = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] standard_threads = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.033974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] use_journal = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] use_json = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] use_journal = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] use_stderr = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] use_json = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] use_syslog = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034459 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] use_stderr = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] use_syslog = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.034702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 17:59:47.034764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.034820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.034882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.034978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.035972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.036935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037442 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.037923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.038907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.039924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.040052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.040285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.040421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.040549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.040676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.040809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.040937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041069 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.041886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.042932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043827 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.043952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.044973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.045101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.045250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.045328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.045489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.045575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.045732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.045866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046395 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.046998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.047947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.048886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.049859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.050260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.050350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.050502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.050581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.050731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.050808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.050970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.051057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.051278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.051362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.051582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.051736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.051874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.051967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.052047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.052240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.052449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.052529 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.052697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.052777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.052943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.053924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.054958 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.055933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.056091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.056168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.056328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.056405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.056591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.056671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.056937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057437 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057830 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.057908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.058910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.059025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.059157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.059446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.059528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.059704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.059785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.059948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] auth.external = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] auth.external = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.060895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] auth.password = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] auth.token = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] auth.password = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] auth.token = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.061999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.062948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] credential.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] credential.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.063902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064077 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.064895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.065913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.066921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.067902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.068850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.069017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.069156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.069281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.090507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.090696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.090786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.090861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.090933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.091935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.092941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.093946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.094941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.095960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096545 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096750 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.096945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.097971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.098953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.099958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.100920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.101950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102165 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102307 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.102981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.103972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104670 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.104999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105067 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] role.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] role.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.105957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] role.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] role.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106256 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.106968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107058 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.107957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108086 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.108981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.109979 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.110987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.111988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.112974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.connection = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.connection = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.113994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.114896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.115974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.116430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 17:59:47.116749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 17:59:47.142658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.142887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.159240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.159428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.159665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.159895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.168025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.168940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.199624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.199896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.200312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.200549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.271479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.272411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.322871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.323075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.328299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.328541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.393717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.393911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.394140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.394357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.394572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.394782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.395217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.395505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.395733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.395956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.396174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.396392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.419420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.419646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.419807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.419895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.419981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.420987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.421172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.432740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.434095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.446230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.446457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.446679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.446896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.447114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.447250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.447337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.447473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.447580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79635) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.447705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.447930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.448152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.448372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.448607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 17:59:47.465779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.465984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 17:59:47.466316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.466518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 17:59:47.466702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.466788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.466930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 17:59:47.467012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.467270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.467351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.467474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 17:59:47.467557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.467747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.468008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.468267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.468525 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.478387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.478387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.478683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.478861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.479541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.479845 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.480417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.480417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.487289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.489030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.490520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.490795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.491070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.491346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.491671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.491929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.492193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.492343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.492464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.492628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.492715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.492911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.492997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.493222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.493310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.493508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.493897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.494170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.494444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.494715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.494987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.495257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.522203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.523729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.524007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.524801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.526547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.526837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.529173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.529453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.532105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.633045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.635430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.635785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.641108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.641410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.644156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.644444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.645892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.646180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.646459 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.646738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.647009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.647278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.647544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.647968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.648988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.649304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.649602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.649885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.650190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.650475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.650904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.651179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.667515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.667991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.670920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.671195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.672902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.676090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.676796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.677105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.679682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.679975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.682062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.684986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.685651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.688532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.689199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.689495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.689775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.690064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.690335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.690605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.692206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.692519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.692806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.693109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.693386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.693783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.710029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.710316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.710578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.710892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.713861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.714210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.715093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.715840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.719175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.721095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.721288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.724028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.724241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.724519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.724806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.725102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.725390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.725920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.726222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.729264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.729549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.729839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.730206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.730915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.738882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.739161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.739436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.739719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.739998 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.740283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.740556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.744209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.744532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.744828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.745126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.745413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.745746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.746517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.758089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.761296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.765293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.766487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.768052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.768691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.769662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.769946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.770223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.772141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.773833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.775475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.775753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.776042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.778121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.779715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.783096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.783387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.783680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.783953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.784178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.785970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.790600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.790600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.790600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.790600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.793034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.793335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.793612 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.799242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.799536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.799894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.801801 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79635) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.802105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.802382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.802673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.802947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.803232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.803498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.803761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.804023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.804294 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.804569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.804844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.805133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.805396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79635) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.808431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 17:59:47.808711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.808994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.809301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.809566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.809854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.810128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.810396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.810687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.810984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.811265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.811560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.811834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.812098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 17:59:47.844166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dfa65e59c0 pid: 79635 (default app) Feb 16 17:59:47.847748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d53e-5d0c-4639-a50b-63a2f0ebe99d None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:59:47.848093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d53e-5d0c-4639-a50b-63a2f0ebe99d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:59:47.848372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d53e-5d0c-4639-a50b-63a2f0ebe99d None None] PATH_INFO: `/v3` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:59:47.851014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dfa65e59c0 pid: 79636 (default app) Feb 16 17:59:47.852624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 791 bytes} [Wed Feb 16 17:59:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 17:59:57.785259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bca774-6616-4d67-b212-a9ada09387e4 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:59:57.785789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bca774-6616-4d67-b212-a9ada09387e4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:59:57.785789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bca774-6616-4d67-b212-a9ada09387e4 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:59:57.791610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1/2] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 17:59:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 17:59:57.798237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:59:57.798773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:59:57.799083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:59:57.833782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG oslo_db.sqlalchemy.engines [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 17:59:58.035405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG passlib.handlers.bcrypt [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79635) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 17:59:58.035836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG passlib.handlers.bcrypt [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79635) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 17:59:58.096201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 17:59:58.097884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 17:59:58.248545 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 2/3] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 17:59:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 17:59:58.416554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bca774-6616-4d67-b212-a9ada09387e4 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:59:58.453050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG oslo_db.sqlalchemy.engines [None req-a7bca774-6616-4d67-b212-a9ada09387e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 17:59:58.581778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bca774-6616-4d67-b212-a9ada09387e4 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:59:58.586514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2d656-eb57-490e-973d-b43de3c30707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:59:58.587185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d656-eb57-490e-973d-b43de3c30707 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:59:58.587469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d656-eb57-490e-973d-b43de3c30707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:59:58.587744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2d656-eb57-490e-973d-b43de3c30707 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:59:58.599625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2d656-eb57-490e-973d-b43de3c30707 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:59:58.652938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00d2d656-eb57-490e-973d-b43de3c30707 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 17:59:58.653335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2d656-eb57-490e-973d-b43de3c30707 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:59:58.663601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 2/4] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 17:59:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 17:59:58.670132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 17:59:58.685838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb84e9f-6633-41d5-884d-cb7dbdcce028 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 17:59:58.690330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a111a-89f9-4432-867d-67606481d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 17:59:58.691447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a111a-89f9-4432-867d-67606481d771 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 17:59:58.691732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a111a-89f9-4432-867d-67606481d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 17:59:58.692008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a111a-89f9-4432-867d-67606481d771 admin admin] PATH_INFO: `/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 17:59:58.693569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a111a-89f9-4432-867d-67606481d771 admin admin] RBAC: Authorizing `identity:get_project(project_id=cbda6004e23b4962aaf44dfcd57b21b1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 17:59:58.747718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.common.rbac_enforcer.enforcer [None req-221a111a-89f9-4432-867d-67606481d771 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 17:59:58.748071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a111a-89f9-4432-867d-67606481d771 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 17:59:58.753483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 3/5] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 17:59:58 2022] GET /identity/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:01.123063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38dc5c-8758-4fbc-9fbb-b34d092b69ce None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:01.123632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38dc5c-8758-4fbc-9fbb-b34d092b69ce None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:01.123632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38dc5c-8758-4fbc-9fbb-b34d092b69ce None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:01.128270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 3/6] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:01.134611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1746b5-8de8-42e1-a783-d6b4c5b7ef00 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:01.135056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1746b5-8de8-42e1-a783-d6b4c5b7ef00 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:01.135187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1746b5-8de8-42e1-a783-d6b4c5b7ef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:01.154646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8d1746b5-8de8-42e1-a783-d6b4c5b7ef00 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:01.156169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8d1746b5-8de8-42e1-a783-d6b4c5b7ef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:01.164115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 4/7] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:01.187130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38dc5c-8758-4fbc-9fbb-b34d092b69ce None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:01.199396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38dc5c-8758-4fbc-9fbb-b34d092b69ce None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:01.205186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5464853-66c7-40aa-8f46-100fcd014767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:01.205835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5464853-66c7-40aa-8f46-100fcd014767 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:01.206119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5464853-66c7-40aa-8f46-100fcd014767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:01.206397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5464853-66c7-40aa-8f46-100fcd014767 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:01.218176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5464853-66c7-40aa-8f46-100fcd014767 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:01.221210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5464853-66c7-40aa-8f46-100fcd014767 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:01.230761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 4/8] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:01.236781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1746b5-8de8-42e1-a783-d6b4c5b7ef00 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:01.245812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1746b5-8de8-42e1-a783-d6b4c5b7ef00 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:01.252656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92993d-a8a7-4896-a0b1-d2a0cee6b148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:01.253580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92993d-a8a7-4896-a0b1-d2a0cee6b148 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:01.253863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92993d-a8a7-4896-a0b1-d2a0cee6b148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:01.254139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92993d-a8a7-4896-a0b1-d2a0cee6b148 admin admin] PATH_INFO: `/v3/users/9e0166f6ee734994acd210881999ef69` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:01.255563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92993d-a8a7-4896-a0b1-d2a0cee6b148 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e0166f6ee734994acd210881999ef69)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:01.257444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92993d-a8a7-4896-a0b1-d2a0cee6b148 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:01.259055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 5/9] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:01 2022] GET /identity/v3/users/9e0166f6ee734994acd210881999ef69 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:03.656817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53b13-698f-43fe-8024-a55e7d04756c None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.657383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53b13-698f-43fe-8024-a55e7d04756c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.657383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d53b13-698f-43fe-8024-a55e7d04756c None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.659149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 5/10] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:03.664392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ff77-cb94-4b94-a25a-6fd480651c96 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.664800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ff77-cb94-4b94-a25a-6fd480651c96 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.665109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ff77-cb94-4b94-a25a-6fd480651c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.683749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1f34ff77-cb94-4b94-a25a-6fd480651c96 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:03.684948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1f34ff77-cb94-4b94-a25a-6fd480651c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:03.692493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 6/11] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:03.716344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53b13-698f-43fe-8024-a55e7d04756c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:03.728585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d53b13-698f-43fe-8024-a55e7d04756c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:03.733853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:03.734642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.734926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.735203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.751439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:03.758491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:03.759716 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 6/12] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:03.762109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f9c3-01cc-43aa-ba6a-47e776fbc133 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.763042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f9c3-01cc-43aa-ba6a-47e776fbc133 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.763328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f9c3-01cc-43aa-ba6a-47e776fbc133 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.765479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 7/13] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:03.766173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:03.770780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a19a-2fde-4b02-95ab-291dbe32fbf4 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.771065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a19a-2fde-4b02-95ab-291dbe32fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.771344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a19a-2fde-4b02-95ab-291dbe32fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.776523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1b10-e116-4596-a74c-67917dca2acb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:03.781857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:03.782515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.782802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.783081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.783831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:03.784139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:03.785932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:03.785932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:00:03.785932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:00:03.786845 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:03.789347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b0b5a19a-2fde-4b02-95ab-291dbe32fbf4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:03.790510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b0b5a19a-2fde-4b02-95ab-291dbe32fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:03.798109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 8/14] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:03.805294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 7/15] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:03.806407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5a19a-2fde-4b02-95ab-291dbe32fbf4 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:03.815803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5a19a-2fde-4b02-95ab-291dbe32fbf4 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:03.820283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:03.821167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.821452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.821567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:03.821724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] PATH_INFO: `/v3/users/9e0166f6ee734994acd210881999ef69` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.823016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e0166f6ee734994acd210881999ef69)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:03.825469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:03.827211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 9/16] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:03 2022] GET /identity/v3/users/9e0166f6ee734994acd210881999ef69 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:03.831762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b05cf6-498a-4042-94fc-5314dcc2532d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:03.832364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:03.836120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:03.836753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.837036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.837339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.842250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0410e-8b21-4bd2-b212-1edb69b24da8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:03.846314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:03.846625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:03.847375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.847654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.847925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.848067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:03.849068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:03.850772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:03.852302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 10/17] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:03.856966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 8/18] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:03.859396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:03.862461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:03.868658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e82699-708f-4ac2-9379-e69fbfe7bd2f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:03.871296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c35cf-7bcc-4433-bdc3-b39bc85b4573 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:03.873006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:03.873662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.873944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.874220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.875035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.domain.id=default, user.id=9e0166f6ee734994acd210881999ef69) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:03.875342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:03.876138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9be8f2-eedd-4daa-a9c3-0ea50573bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:03.876902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be8f2-eedd-4daa-a9c3-0ea50573bb56 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:03.877065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:03.877065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:03.877065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:03.877261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be8f2-eedd-4daa-a9c3-0ea50573bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:03.877501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be8f2-eedd-4daa-a9c3-0ea50573bb56 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:03.878246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de120-eba3-42c9-bb3d-742f80afe531 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:03.879157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9be8f2-eedd-4daa-a9c3-0ea50573bb56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:03.880706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9be8f2-eedd-4daa-a9c3-0ea50573bb56 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:03.882410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 9/19] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:03.885567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 11/20] 10.222.0.87 () {56 vars in 1343 bytes} [Wed Feb 16 18:00:03 2022] GET /identity/v3/role_assignments?user.id=9e0166f6ee734994acd210881999ef69&scope.domain.id=default&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 233 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:06.835081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973526f-8bca-4f47-97ea-c0786e9664a0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:06.836142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973526f-8bca-4f47-97ea-c0786e9664a0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:06.836627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973526f-8bca-4f47-97ea-c0786e9664a0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:06.839050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 10/21] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:06.846618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f85d-dc13-4d6f-82c9-ea3f0c18d59a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:06.847540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f85d-dc13-4d6f-82c9-ea3f0c18d59a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:06.848020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1f85d-dc13-4d6f-82c9-ea3f0c18d59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:06.874627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9bc1f85d-dc13-4d6f-82c9-ea3f0c18d59a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:06.876208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9bc1f85d-dc13-4d6f-82c9-ea3f0c18d59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:06.885000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 12/22] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:06.927204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973526f-8bca-4f47-97ea-c0786e9664a0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:06.942153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973526f-8bca-4f47-97ea-c0786e9664a0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:06.947175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:06.948284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:06.948768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:06.949267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:06.971261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:06.978723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:06.980561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 11/23] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:06.988170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1f85d-dc13-4d6f-82c9-ea3f0c18d59a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:06.998585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1f85d-dc13-4d6f-82c9-ea3f0c18d59a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.009421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.010461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.010971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.011445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.012564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:07.013098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.014328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:07.014328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:07.014328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:07.015660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.041571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 13/24] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:07.048407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.060155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd72a5-e9c4-4005-a2e5-9b76dede39d1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.069476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20e750-caeb-4a9b-9b1a-bc4d3d0096c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.070685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e750-caeb-4a9b-9b1a-bc4d3d0096c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.071173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e750-caeb-4a9b-9b1a-bc4d3d0096c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.071647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20e750-caeb-4a9b-9b1a-bc4d3d0096c5 admin admin] PATH_INFO: `/v3/users/9e0166f6ee734994acd210881999ef69` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.074017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20e750-caeb-4a9b-9b1a-bc4d3d0096c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e0166f6ee734994acd210881999ef69)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.076199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20e750-caeb-4a9b-9b1a-bc4d3d0096c5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.078485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 12/25] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:07 2022] GET /identity/v3/users/9e0166f6ee734994acd210881999ef69 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:07.083579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.098770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dade0-bc51-4860-a471-bef5248ff5aa admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.110969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139560b-e19d-418c-88d6-78914d284101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.111789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139560b-e19d-418c-88d6-78914d284101 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.112076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139560b-e19d-418c-88d6-78914d284101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.112378 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139560b-e19d-418c-88d6-78914d284101 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.115342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139560b-e19d-418c-88d6-78914d284101 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.116368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfe72f-4cd9-4c33-882e-2e7c24028fc6 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.116905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfe72f-4cd9-4c33-882e-2e7c24028fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.117403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfe72f-4cd9-4c33-882e-2e7c24028fc6 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.118255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139560b-e19d-418c-88d6-78914d284101 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.119929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 13/26] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:07.121271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 14/27] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:07.127727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfe72f-4cd9-4c33-882e-2e7c24028fc6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.132981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40236656-532a-4a1b-b4ed-a04868658ca5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.133314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40236656-532a-4a1b-b4ed-a04868658ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.133811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40236656-532a-4a1b-b4ed-a04868658ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.144366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfe72f-4cd9-4c33-882e-2e7c24028fc6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.150620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.151865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.152355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.153738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] PATH_INFO: `/v3/domains/default/users/9e0166f6ee734994acd210881999ef69/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.156125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9e0166f6ee734994acd210881999ef69, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.157437 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:07.157437 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:00:07.157437 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:00:07.159649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-40236656-532a-4a1b-b4ed-a04868658ca5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:07.160013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.161464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-40236656-532a-4a1b-b4ed-a04868658ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:07.179938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 15/28] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:07.186002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128672-f184-4372-a9da-85d41bd3a9d7 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.186298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128672-f184-4372-a9da-85d41bd3a9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.186712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128672-f184-4372-a9da-85d41bd3a9d7 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.189112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 16/29] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:07.199105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99a46-76bf-451c-8332-d124b58f737c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.199400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99a46-76bf-451c-8332-d124b58f737c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.199704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99a46-76bf-451c-8332-d124b58f737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.232164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-44b99a46-76bf-451c-8332-d124b58f737c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:07.233556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-44b99a46-76bf-451c-8332-d124b58f737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:07.243025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 17/30] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:07.243976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b99a46-76bf-451c-8332-d124b58f737c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.254165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b99a46-76bf-451c-8332-d124b58f737c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.259016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c359f59-a334-4f9d-8fd2-e1b4954e4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.259820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c359f59-a334-4f9d-8fd2-e1b4954e4a6c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.260099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c359f59-a334-4f9d-8fd2-e1b4954e4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.260373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c359f59-a334-4f9d-8fd2-e1b4954e4a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.261154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c359f59-a334-4f9d-8fd2-e1b4954e4a6c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.262347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-4c359f59-a334-4f9d-8fd2-e1b4954e4a6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:07.262347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:07.262347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:07.263292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c359f59-a334-4f9d-8fd2-e1b4954e4a6c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.478870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 14/31] 10.222.0.87 () {58 vars in 1382 bytes} [Wed Feb 16 18:00:07 2022] PUT /identity/v3/domains/default/users/9e0166f6ee734994acd210881999ef69/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:07.486724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.562167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 18/32] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:00:07 2022] POST /identity/v3/roles => generated 225 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:07.563857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9d51-b9db-4fb0-b413-2d6418762557 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.564399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9d51-b9db-4fb0-b413-2d6418762557 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.564685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9d51-b9db-4fb0-b413-2d6418762557 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.567756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 19/33] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:07.575493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea2cf-0ec0-467c-8d57-5aaf41d3e919 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.575816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea2cf-0ec0-467c-8d57-5aaf41d3e919 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.576073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea2cf-0ec0-467c-8d57-5aaf41d3e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.619145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0aaea2cf-0ec0-467c-8d57-5aaf41d3e919 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:07.621769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0aaea2cf-0ec0-467c-8d57-5aaf41d3e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:07.715111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 20/34] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:07.723701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b877ac-da37-4c66-94e9-1c46d1fa34e9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.739174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.740147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.740592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.741024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.742054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.743756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:07.743756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:00:07.743756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:00:07.745025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.763615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaea2cf-0ec0-467c-8d57-5aaf41d3e919 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.780003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaea2cf-0ec0-467c-8d57-5aaf41d3e919 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.791276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.792609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.792948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.793259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.813800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.815919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.849121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:00:07.849121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 21/35] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:07.854845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.856500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 15/36] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:00:07 2022] POST /identity/v3/roles => generated 219 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:07.869641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceb825-dbae-4913-99c1-5611b31ccb7b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.876852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.877675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.878018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.878366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.879164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:07.879480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.880755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:07.880755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:07.880755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:07.881749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e378af0-eadb-433b-87a0-493b425bfdb3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:07.911777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 22/37] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:07.917522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:07.934237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e960edf-57d5-4c0a-ab5c-4d83498cfcca admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:07.941459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e2c9a-fee0-4aa4-8396-c91c7999a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:07.942213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e2c9a-fee0-4aa4-8396-c91c7999a45d admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:07.942502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e2c9a-fee0-4aa4-8396-c91c7999a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:07.942785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e2c9a-fee0-4aa4-8396-c91c7999a45d admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:07.943618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e2c9a-fee0-4aa4-8396-c91c7999a45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:07.944691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-d73e2c9a-fee0-4aa4-8396-c91c7999a45d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:07.944691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:00:07.944691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:00:07.945965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e2c9a-fee0-4aa4-8396-c91c7999a45d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:08.062018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 16/38] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:00:07 2022] POST /identity/v3/projects => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:08.409827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7427236-c664-4152-b683-d6c37192b299 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:08.410242 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7427236-c664-4152-b683-d6c37192b299 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:08.410446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7427236-c664-4152-b683-d6c37192b299 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:08.412360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 23/39] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:08.419702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:08.420344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:08.420917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:08.439491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG passlib.handlers.bcrypt [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79636) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 18:00:08.440275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG passlib.handlers.bcrypt [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79636) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 18:00:08.465394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5d439-07a0-40ac-9821-e08cb81b8873 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:08.465753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5d439-07a0-40ac-9821-e08cb81b8873 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:08.465965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5d439-07a0-40ac-9821-e08cb81b8873 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:08.468024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 24/40] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:08.473168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512117-9d94-4572-9314-eb2130aade56 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:08.473466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512117-9d94-4572-9314-eb2130aade56 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:08.473754 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512117-9d94-4572-9314-eb2130aade56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:08.488634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:08.490524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:08.492387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-4b512117-9d94-4572-9314-eb2130aade56 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:08.493594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4b512117-9d94-4572-9314-eb2130aade56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:08.565399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 25/41] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:08.571011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 17/42] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:08.588976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512117-9d94-4572-9314-eb2130aade56 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:08.596331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:08.603217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512117-9d94-4572-9314-eb2130aade56 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:08.607861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a2248-eb56-4625-8bc9-35cc9cc9940c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:08.609197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ad19c-d32b-44af-8bec-a895b1357eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:08.609898 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad19c-d32b-44af-8bec-a895b1357eea admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:08.610192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad19c-d32b-44af-8bec-a895b1357eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:08.610470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ad19c-d32b-44af-8bec-a895b1357eea admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:08.611277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ad19c-d32b-44af-8bec-a895b1357eea admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:08.612901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251036-057c-4037-8544-d939d525904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:08.613032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ad19c-d32b-44af-8bec-a895b1357eea admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:08.614049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251036-057c-4037-8544-d939d525904f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:08.614342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251036-057c-4037-8544-d939d525904f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:08.614624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251036-057c-4037-8544-d939d525904f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:08.616345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251036-057c-4037-8544-d939d525904f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:08.618199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251036-057c-4037-8544-d939d525904f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:08.619973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 18/43] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:08.626535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251036-057c-4037-8544-d939d525904f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:08.637284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251036-057c-4037-8544-d939d525904f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:08.642725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d0558-daf4-4ccd-8d5f-0ebd9fe69eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:08.643410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0558-daf4-4ccd-8d5f-0ebd9fe69eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:08.643707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0558-daf4-4ccd-8d5f-0ebd9fe69eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:08.644225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0558-daf4-4ccd-8d5f-0ebd9fe69eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:08.645283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d0558-daf4-4ccd-8d5f-0ebd9fe69eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:08.647364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d0558-daf4-4ccd-8d5f-0ebd9fe69eb9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:08.707903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 26/44] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:00:08 2022] POST /identity/v3/roles => generated 223 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:08.769344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 19/45] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:00:08 2022] POST /identity/v3/projects => generated 312 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:00:10.222573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b7be-b0c0-4896-b947-1e558f71baf9 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:10.223123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b7be-b0c0-4896-b947-1e558f71baf9 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:10.223123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b7be-b0c0-4896-b947-1e558f71baf9 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:10.225042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 27/46] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:10.231895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df9f0-5d89-4874-b13b-b09e253fa754 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:10.232402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df9f0-5d89-4874-b13b-b09e253fa754 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:10.232581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4df9f0-5d89-4874-b13b-b09e253fa754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:10.250708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4e4df9f0-5d89-4874-b13b-b09e253fa754 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:10.251898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4e4df9f0-5d89-4874-b13b-b09e253fa754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:10.310788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 20/47] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:10.334006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60b7be-b0c0-4896-b947-1e558f71baf9 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:10.346760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60b7be-b0c0-4896-b947-1e558f71baf9 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:10.353881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:10.353881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:10.353881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:10.353881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:10.364601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:10.371617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:10.373190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 28/48] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:10.378960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df9f0-5d89-4874-b13b-b09e253fa754 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:10.388078 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4df9f0-5d89-4874-b13b-b09e253fa754 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:10.392591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:10.393289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:10.393579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:10.393860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:10.394613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:10.394922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:10.396545 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:10.405631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 21/49] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:10.411017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:10.422064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28491b-ddb9-40ab-bc2c-11a386543364 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:10.426951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:10.427815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:10.428104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:10.428385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] PATH_INFO: `/v3/users/9e0166f6ee734994acd210881999ef69` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:10.429610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] RBAC: Authorizing `identity:get_user(user_id=9e0166f6ee734994acd210881999ef69)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:10.431449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:10.433103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 29/50] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:10 2022] GET /identity/v3/users/9e0166f6ee734994acd210881999ef69 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:10.438791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:10.448708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b3e8e-71d7-41d8-a4c6-5bc28f345801 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:10.453353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1abe5a-858d-4e0d-b4cc-872e9776fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:10.454147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1abe5a-858d-4e0d-b4cc-872e9776fbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:10.454430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1abe5a-858d-4e0d-b4cc-872e9776fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:10.454703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1abe5a-858d-4e0d-b4cc-872e9776fbc4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:10.455889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1abe5a-858d-4e0d-b4cc-872e9776fbc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:10.457691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1abe5a-858d-4e0d-b4cc-872e9776fbc4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:10.459303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 22/51] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:10.465018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:10.476085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade2643-c178-46b7-a76e-1b78ad314f2b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:10.489304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6199817-d214-4989-94ca-6670766f1f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:10.490017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199817-d214-4989-94ca-6670766f1f3d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:10.490251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199817-d214-4989-94ca-6670766f1f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:10.490528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199817-d214-4989-94ca-6670766f1f3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:10.491361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6199817-d214-4989-94ca-6670766f1f3d admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.domain.id=default, user.id=9e0166f6ee734994acd210881999ef69) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:10.491671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6199817-d214-4989-94ca-6670766f1f3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:10.493561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6199817-d214-4989-94ca-6670766f1f3d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:10.499825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 30/52] 10.222.0.87 () {56 vars in 1343 bytes} [Wed Feb 16 18:00:10 2022] GET /identity/v3/role_assignments?user.id=9e0166f6ee734994acd210881999ef69&scope.domain.id=default&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 530 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:11.208564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51ba8-376e-4416-91a6-f18dfe554357 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:11.208860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51ba8-376e-4416-91a6-f18dfe554357 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:11.209185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51ba8-376e-4416-91a6-f18dfe554357 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:11.210990 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 23/53] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:11.216526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeee809-1cbd-47c5-9dcc-a2a5ce9ded0c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:11.216821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeee809-1cbd-47c5-9dcc-a2a5ce9ded0c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:11.217159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeee809-1cbd-47c5-9dcc-a2a5ce9ded0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:11.235351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-dbeee809-1cbd-47c5-9dcc-a2a5ce9ded0c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:11.236566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dbeee809-1cbd-47c5-9dcc-a2a5ce9ded0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:11.244908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 31/54] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:11.269963 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51ba8-376e-4416-91a6-f18dfe554357 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:11.284727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51ba8-376e-4416-91a6-f18dfe554357 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:11.289176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b1f67-324b-4dca-ad24-2ec5c9a3d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:11.289969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b1f67-324b-4dca-ad24-2ec5c9a3d97f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:11.290253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b1f67-324b-4dca-ad24-2ec5c9a3d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:11.290532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b1f67-324b-4dca-ad24-2ec5c9a3d97f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:11.291715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b1f67-324b-4dca-ad24-2ec5c9a3d97f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:11.293952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b1f67-324b-4dca-ad24-2ec5c9a3d97f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:11.295575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 24/55] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:11.301641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeee809-1cbd-47c5-9dcc-a2a5ce9ded0c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:11.311587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeee809-1cbd-47c5-9dcc-a2a5ce9ded0c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:11.316042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb094c-80c2-4b98-8764-fa47da861e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:11.316704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb094c-80c2-4b98-8764-fa47da861e71 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:11.316991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb094c-80c2-4b98-8764-fa47da861e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:11.317298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb094c-80c2-4b98-8764-fa47da861e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:11.318023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb094c-80c2-4b98-8764-fa47da861e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:11.319052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-dfdb094c-80c2-4b98-8764-fa47da861e71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:11.319052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:11.319052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:11.320290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb094c-80c2-4b98-8764-fa47da861e71 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:11.410713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 32/56] 10.222.0.87 () {60 vars in 1161 bytes} [Wed Feb 16 18:00:11 2022] POST /identity/v3/projects => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:13.828127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefd341-9587-4e26-a4c2-40c5c5d959a0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:13.828684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefd341-9587-4e26-a4c2-40c5c5d959a0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:13.828684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefd341-9587-4e26-a4c2-40c5c5d959a0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:13.830600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 25/57] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:13.836206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cd33-129e-47c6-9da9-072bd2eae04d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:13.836602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cd33-129e-47c6-9da9-072bd2eae04d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:13.836804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cd33-129e-47c6-9da9-072bd2eae04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:13.855370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-22d2cd33-129e-47c6-9da9-072bd2eae04d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:13.856704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-22d2cd33-129e-47c6-9da9-072bd2eae04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:13.916660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 33/58] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:13.943466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefd341-9587-4e26-a4c2-40c5c5d959a0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:13.957167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefd341-9587-4e26-a4c2-40c5c5d959a0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:13.961568 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b627-99a3-450b-bd08-f2fc47588466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:13.962370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b627-99a3-450b-bd08-f2fc47588466 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:13.962648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b627-99a3-450b-bd08-f2fc47588466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:13.962923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b627-99a3-450b-bd08-f2fc47588466 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:13.964100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b627-99a3-450b-bd08-f2fc47588466 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:13.966614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b627-99a3-450b-bd08-f2fc47588466 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:13.968273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 26/59] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:13.974003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2cd33-129e-47c6-9da9-072bd2eae04d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:13.984514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2cd33-129e-47c6-9da9-072bd2eae04d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:13.989014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2a4f-f13c-4613-9e36-7fb3483def45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:13.989899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2a4f-f13c-4613-9e36-7fb3483def45 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:13.990180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2a4f-f13c-4613-9e36-7fb3483def45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:13.990463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2a4f-f13c-4613-9e36-7fb3483def45 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:13.991223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b2a4f-f13c-4613-9e36-7fb3483def45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:13.992328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-8b2b2a4f-f13c-4613-9e36-7fb3483def45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:13.992328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:13.992328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:13.993646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b2a4f-f13c-4613-9e36-7fb3483def45 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:14.098770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 34/60] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:00:13 2022] POST /identity/v3/users => generated 275 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:18.396840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ea4c-7560-4d26-a350-72449373f0e9 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.398205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ea4c-7560-4d26-a350-72449373f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.398906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ea4c-7560-4d26-a350-72449373f0e9 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.402103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 27/61] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:18.410854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186784-a111-4efe-900a-8e2ce0b7073b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.412193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186784-a111-4efe-900a-8e2ce0b7073b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.412949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186784-a111-4efe-900a-8e2ce0b7073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.450831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-27186784-a111-4efe-900a-8e2ce0b7073b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:18.453020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-27186784-a111-4efe-900a-8e2ce0b7073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:18.468263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f92286-4ddc-409e-98a9-a41877e4d743 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.469112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f92286-4ddc-409e-98a9-a41877e4d743 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.469752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f92286-4ddc-409e-98a9-a41877e4d743 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.472879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 28/62] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:18.479204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 35/63] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:18.479987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d30ac0-59cc-4e2a-8de2-e7b639d6e3d1 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.480695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d30ac0-59cc-4e2a-8de2-e7b639d6e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.481957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d30ac0-59cc-4e2a-8de2-e7b639d6e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.523760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-73d30ac0-59cc-4e2a-8de2-e7b639d6e3d1 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:18.525894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-73d30ac0-59cc-4e2a-8de2-e7b639d6e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:18.541967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 29/64] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:18.558762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186784-a111-4efe-900a-8e2ce0b7073b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.574355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d30ac0-59cc-4e2a-8de2-e7b639d6e3d1 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.592627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186784-a111-4efe-900a-8e2ce0b7073b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.596056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d30ac0-59cc-4e2a-8de2-e7b639d6e3d1 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.608260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.610709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.611864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.613263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.614195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.614850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.616198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.616694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.647244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:18.648746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:18.663306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:18.665345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 36/65] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:18.678093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.680997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:18.683516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 30/66] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:18.690916 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.710383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdec442-3fa5-4bdd-a2f1-04ec72463a89 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.712979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10ca12-bbd8-4e0c-ab8b-384ebb8ba159 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.721704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.723130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.724483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.725052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.725575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.726576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.727985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:18.728708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.729433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.730315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.732022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:18.734894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.735749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.738501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.753125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 31/67] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:18.761726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.774526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 37/68] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:18.784204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9b2b4-4824-4e14-aa8c-0e24ed163d07 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.785563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.791621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.793404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.794085 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.794717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] PATH_INFO: `/v3/users/9e0166f6ee734994acd210881999ef69` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.797261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] RBAC: Authorizing `identity:get_user(user_id=9e0166f6ee734994acd210881999ef69)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.800402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.803884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 32/69] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/users/9e0166f6ee734994acd210881999ef69 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:18.811620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.813149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af760a-41f4-448d-b9e1-e96b330aa095 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.828526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be2a0-9d39-40f2-b487-c4f8d51beded admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.834199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.835557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.835989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.836344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012783b-0b58-4d7b-a6f3-aaf1f77b33b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.836506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.837955 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012783b-0b58-4d7b-a6f3-aaf1f77b33b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.838617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012783b-0b58-4d7b-a6f3-aaf1f77b33b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.839321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012783b-0b58-4d7b-a6f3-aaf1f77b33b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.852611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012783b-0b58-4d7b-a6f3-aaf1f77b33b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.855737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012783b-0b58-4d7b-a6f3-aaf1f77b33b1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.863231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.867248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.870286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 33/70] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:18.870653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 38/71] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:18.873037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655c8d5-f72c-469c-865c-c5891d78607f None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.873813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655c8d5-f72c-469c-865c-c5891d78607f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.874451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655c8d5-f72c-469c-865c-c5891d78607f None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.877708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 34/72] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:18.879267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.885848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a19a-0f44-4758-9dba-38106207c84d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.886678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a19a-0f44-4758-9dba-38106207c84d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.887918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a19a-0f44-4758-9dba-38106207c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.892926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da21b3-342e-42ca-9927-a573cef56275 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.897556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.898221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.898509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.898797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.908729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.910606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.918858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-62a4a19a-0f44-4758-9dba-38106207c84d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:18.921023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-62a4a19a-0f44-4758-9dba-38106207c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:18.921236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 39/73] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:18.921922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.938394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4e571-6c01-431b-9c74-402a58f2cb42 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.941324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 35/74] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:18.942393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a19a-0f44-4758-9dba-38106207c84d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.952600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.954190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.954860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.955394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.958803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.964468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a19a-0f44-4758-9dba-38106207c84d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.966573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.968634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 40/75] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:18.971239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.976193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17617ea9-7c6f-4a81-9b3f-d7bc604173bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.977101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617ea9-7c6f-4a81-9b3f-d7bc604173bb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.977561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617ea9-7c6f-4a81-9b3f-d7bc604173bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.978079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617ea9-7c6f-4a81-9b3f-d7bc604173bb admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.979321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17617ea9-7c6f-4a81-9b3f-d7bc604173bb admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:18.981979 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17617ea9-7c6f-4a81-9b3f-d7bc604173bb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:18.984927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 36/76] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:18.986295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3feb2-7e9c-41d8-b814-95a2f0ffaeb5 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.986590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3feb2-7e9c-41d8-b814-95a2f0ffaeb5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.986874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3feb2-7e9c-41d8-b814-95a2f0ffaeb5 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:18.988369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1df33-7028-40e4-aecf-8b8ea79b833e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:18.989043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 37/77] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:18.989944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3feb2-7e9c-41d8-b814-95a2f0ffaeb5 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:18.997307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:18.998143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:18.998432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:18.998714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.005846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3feb2-7e9c-41d8-b814-95a2f0ffaeb5 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.010473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.010910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:19.011137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.011425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.011706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.013116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=9e0166f6ee734994acd210881999ef69) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:19.013431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.014441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:19.014441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:00:19.014441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:00:19.015607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60bfc1-e895-407f-9121-9578a445bf10 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.019343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:19.020965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 41/78] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:19.021499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.025671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 38/79] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:18 2022] GET /identity/v3/role_assignments?user.id=9e0166f6ee734994acd210881999ef69&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.027405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a67b39-11dc-4497-83b1-f6a4018278bc None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.028519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a67b39-11dc-4497-83b1-f6a4018278bc None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.029680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a67b39-11dc-4497-83b1-f6a4018278bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.033813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea91c-395c-4d4b-9789-a58c94e80e8e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.038605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.039286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.040422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.040422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.040748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=5abd0ea4fb81436881102a7e93ae2675) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:19.041071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.043180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.051145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 42/80] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/role_assignments?user.id=5abd0ea4fb81436881102a7e93ae2675&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.052105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.055120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f0a67b39-11dc-4497-83b1-f6a4018278bc None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:19.056631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f0a67b39-11dc-4497-83b1-f6a4018278bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:19.063703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b223-e4df-416e-8b45-98f42a740417 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.070351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.071045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.071267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.071502 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.071620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 39/81] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:19.077379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:19.077379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.077379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.086172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 43/82] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.092713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a67b39-11dc-4497-83b1-f6a4018278bc None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.111649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a67b39-11dc-4497-83b1-f6a4018278bc None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.123774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.124613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.126177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.126669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.127246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.129219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.132567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.139075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 40/83] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:19.139256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1b71b-cc3f-449f-ac61-09f34863b87e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.141970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.146005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.147127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.147684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.148162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.156211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.158399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.159708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e6135-0974-44a6-88aa-5c65910a5fba admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.161027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 44/84] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.171462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.174281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.175253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.175925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.176334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.185644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288e0b6-4a63-424b-a4e8-1567fd132c4b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.194187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.196404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.205133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.205133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.205133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.205133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.205780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.208401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.210174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 41/85] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:19.225194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.236422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6ea0-a138-4da8-8b20-a7ad5dd2829c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.241575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd1441-9996-4352-bf60-b18d8da0ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.242565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1441-9996-4352-bf60-b18d8da0ef80 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.242865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1441-9996-4352-bf60-b18d8da0ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.243342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1441-9996-4352-bf60-b18d8da0ef80 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.244729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd1441-9996-4352-bf60-b18d8da0ef80 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.249269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd1441-9996-4352-bf60-b18d8da0ef80 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.249956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 42/86] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:19.254051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6235d0-4187-49e2-bd06-670149e6fcdd None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.254051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6235d0-4187-49e2-bd06-670149e6fcdd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.254051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6235d0-4187-49e2-bd06-670149e6fcdd None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.254051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 43/87] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:19.258849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6235d0-4187-49e2-bd06-670149e6fcdd None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.274492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6235d0-4187-49e2-bd06-670149e6fcdd None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.279410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e864a1-79d9-49a7-854a-1819e53deac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.280086 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e864a1-79d9-49a7-854a-1819e53deac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.280403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e864a1-79d9-49a7-854a-1819e53deac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.280681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e864a1-79d9-49a7-854a-1819e53deac5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.281555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e864a1-79d9-49a7-854a-1819e53deac5 admin admin] RBAC: Adding query filter params (role.id=dc6090b70eff456892de81377068fadd, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=5abd0ea4fb81436881102a7e93ae2675) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:19.281914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e864a1-79d9-49a7-854a-1819e53deac5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.283800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e864a1-79d9-49a7-854a-1819e53deac5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.290120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 44/88] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/role_assignments?user.id=5abd0ea4fb81436881102a7e93ae2675&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=dc6090b70eff456892de81377068fadd => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.291815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d77f-cc1c-4ab1-b725-2c0ebdf0d3da None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.292228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d77f-cc1c-4ab1-b725-2c0ebdf0d3da None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.292622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d77f-cc1c-4ab1-b725-2c0ebdf0d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.315529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-68c8d77f-cc1c-4ab1-b725-2c0ebdf0d3da None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:19.316787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-68c8d77f-cc1c-4ab1-b725-2c0ebdf0d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:19.323723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 45/89] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:00:19 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:00:19.326052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 45/90] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:19.354222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.368528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b2346-eda3-4716-86f3-8e7d1737e2fe admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.377467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.378818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.379265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.386765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.404492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:19.412109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:19.413838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 46/91] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:19.420222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8d77f-cc1c-4ab1-b725-2c0ebdf0d3da None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.436223 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8d77f-cc1c-4ab1-b725-2c0ebdf0d3da None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.445917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.446630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.446920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.447203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.448029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:19.448344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.450968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.467276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 46/92] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.474329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.510381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bc730-1112-4995-9b03-2b4ba6708a9f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.510381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.510381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.510381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.510899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.510899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.510899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.510899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 47/93] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.511597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.530240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d243f-63a9-4675-b35a-c781779ebfc8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.541640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.542382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.542675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.542961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.557728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.560016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.574252 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 47/94] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:19.580663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.594876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dbe5b-36f0-40fb-bca2-503f5b87d318 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.601564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11711042-fb59-4e0d-b0d4-99b5c54c1cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.602536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11711042-fb59-4e0d-b0d4-99b5c54c1cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.602850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11711042-fb59-4e0d-b0d4-99b5c54c1cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.603143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11711042-fb59-4e0d-b0d4-99b5c54c1cb6 admin admin] PATH_INFO: `/v3/projects/8e142e1c917d4ac69976f5315fcbc459` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.604452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11711042-fb59-4e0d-b0d4-99b5c54c1cb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e142e1c917d4ac69976f5315fcbc459)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.606707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11711042-fb59-4e0d-b0d4-99b5c54c1cb6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.610209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 48/95] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/projects/8e142e1c917d4ac69976f5315fcbc459 => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:19.615156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:19.629323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad448-7c6e-46bf-a7e0-03a4400b4654 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:19.636831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492012e-8b83-404b-be77-0928f859c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:19.638868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492012e-8b83-404b-be77-0928f859c672 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:19.639736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492012e-8b83-404b-be77-0928f859c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:19.640329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492012e-8b83-404b-be77-0928f859c672 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:19.641575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492012e-8b83-404b-be77-0928f859c672 admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=8e142e1c917d4ac69976f5315fcbc459, user.id=5abd0ea4fb81436881102a7e93ae2675) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:19.642097 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492012e-8b83-404b-be77-0928f859c672 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:19.644183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492012e-8b83-404b-be77-0928f859c672 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:19.650929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 48/96] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:19 2022] GET /identity/v3/role_assignments?user.id=5abd0ea4fb81436881102a7e93ae2675&scope.project.id=8e142e1c917d4ac69976f5315fcbc459&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:22.219835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a601c0-f3ba-4f77-b3c7-39c9469eaad8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.220375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a601c0-f3ba-4f77-b3c7-39c9469eaad8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.220858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a601c0-f3ba-4f77-b3c7-39c9469eaad8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.224833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 49/97] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:22.231903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e532f-56ad-475c-a72b-4e7fcfff7346 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.233808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e532f-56ad-475c-a72b-4e7fcfff7346 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.234350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e532f-56ad-475c-a72b-4e7fcfff7346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.266797 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-916e532f-56ad-475c-a72b-4e7fcfff7346 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:22.268567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-916e532f-56ad-475c-a72b-4e7fcfff7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:22.280486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 49/98] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:22.327104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a601c0-f3ba-4f77-b3c7-39c9469eaad8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:22.375814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a601c0-f3ba-4f77-b3c7-39c9469eaad8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:22.392556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:22.393990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.394609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.395075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.430111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:22.444727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:22.456996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 50/99] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:22.465042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e532f-56ad-475c-a72b-4e7fcfff7346 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:22.486510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e532f-56ad-475c-a72b-4e7fcfff7346 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:22.503393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:22.504629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.505179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.505720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.506687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:22.507239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:22.509813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:22.529000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 50/100] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:22.534243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:22.556185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d181-82c4-4498-8a9f-a238bc557965 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:22.565603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:22.566508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.566798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.567076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.568371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:22.570601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:22.572548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 51/101] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:22 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:22.579212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:22.592186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7472c05-3806-4e73-a384-b1597b3b9dbf admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:22.597524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efecd9e-afa5-4169-86c6-9ddcd879cceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:22.598940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efecd9e-afa5-4169-86c6-9ddcd879cceb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.599446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efecd9e-afa5-4169-86c6-9ddcd879cceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.599956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efecd9e-afa5-4169-86c6-9ddcd879cceb admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.601652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efecd9e-afa5-4169-86c6-9ddcd879cceb admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:22.604141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efecd9e-afa5-4169-86c6-9ddcd879cceb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:22.607698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 51/102] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:22 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:22.615693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:22.635418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d617-a68e-434d-bbb6-a1700beb583f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:22.647131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dff7e-ab2b-463b-abd7-274d4da2cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:22.648594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dff7e-ab2b-463b-abd7-274d4da2cc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.649042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dff7e-ab2b-463b-abd7-274d4da2cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.649517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dff7e-ab2b-463b-abd7-274d4da2cc30 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/5abd0ea4fb81436881102a7e93ae2675/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.652615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dff7e-ab2b-463b-abd7-274d4da2cc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d4a5ac6711498799101bfed49ee0ba, user_id=5abd0ea4fb81436881102a7e93ae2675, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:22.654895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-3d7dff7e-ab2b-463b-abd7-274d4da2cc30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:22.654895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:22.654895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:22.658286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dff7e-ab2b-463b-abd7-274d4da2cc30 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:22.762573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 52/103] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:22 2022] PUT /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/5abd0ea4fb81436881102a7e93ae2675/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:22.864721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f02599-31a3-4273-a171-5243e53655c0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.865406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f02599-31a3-4273-a171-5243e53655c0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.865950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f02599-31a3-4273-a171-5243e53655c0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.868261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 52/104] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:22.880825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eafe9-0113-425e-8ff7-163e1ab0e4c6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:22.881306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eafe9-0113-425e-8ff7-163e1ab0e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:22.881767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eafe9-0113-425e-8ff7-163e1ab0e4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:22.920503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8b5eafe9-0113-425e-8ff7-163e1ab0e4c6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:22.922488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8b5eafe9-0113-425e-8ff7-163e1ab0e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:23.019223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 53/105] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:23.058490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f02599-31a3-4273-a171-5243e53655c0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.093874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f02599-31a3-4273-a171-5243e53655c0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.100826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.102205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.102705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.103386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.117513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:23.127581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:23.129302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 53/106] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:23.135620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eafe9-0113-425e-8ff7-163e1ab0e4c6 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.146624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eafe9-0113-425e-8ff7-163e1ab0e4c6 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.151863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0d89b-1bbc-4729-88d8-70e199546beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.153970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0d89b-1bbc-4729-88d8-70e199546beb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.154592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0d89b-1bbc-4729-88d8-70e199546beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.155078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0d89b-1bbc-4729-88d8-70e199546beb admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.156119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0d89b-1bbc-4729-88d8-70e199546beb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:23.156667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0d89b-1bbc-4729-88d8-70e199546beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.158680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0d89b-1bbc-4729-88d8-70e199546beb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.170057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 54/107] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:23.176486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.189402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ed361-b53a-4c70-82a1-024c145ab99b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.194599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.195820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.196347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.197349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.201101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.202012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.204250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c71d1-cac9-479a-98f7-01fa060c7f5f None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.204546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c71d1-cac9-479a-98f7-01fa060c7f5f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.204832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c71d1-cac9-479a-98f7-01fa060c7f5f None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.206757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 55/108] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:23.208341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 54/109] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:23.212600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0d48-c2d3-4187-8a8e-80200a4aec5f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.212901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0d48-c2d3-4187-8a8e-80200a4aec5f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.213249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0d48-c2d3-4187-8a8e-80200a4aec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.224031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.236393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-97df0d48-c2d3-4187-8a8e-80200a4aec5f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:23.237957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-97df0d48-c2d3-4187-8a8e-80200a4aec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:23.241787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f9cc-61ec-4b3f-a46f-18032d4347de admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.247201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 56/110] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:23.256806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.257974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.258269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.258556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.259893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.263032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.265383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 55/111] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:23.271357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df0d48-c2d3-4187-8a8e-80200a4aec5f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.282435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df0d48-c2d3-4187-8a8e-80200a4aec5f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.288179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.290560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.298642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.299112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.299548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/5abd0ea4fb81436881102a7e93ae2675/roles/dc6090b70eff456892de81377068fadd` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.306833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d4a5ac6711498799101bfed49ee0ba, user_id=5abd0ea4fb81436881102a7e93ae2675, role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.310785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46eae-2981-43f2-a201-18ed67230f6c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.314067 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.325762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811f961-d30f-444c-b6ed-14e491399b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.326854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f961-d30f-444c-b6ed-14e491399b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.327144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f961-d30f-444c-b6ed-14e491399b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.327426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f961-d30f-444c-b6ed-14e491399b4f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.341302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811f961-d30f-444c-b6ed-14e491399b4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:23.349412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-8811f961-d30f-444c-b6ed-14e491399b4f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:23.350941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 56/112] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:23.352665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12eb2-d5f3-4534-9221-f86d695e701b None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.352967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12eb2-d5f3-4534-9221-f86d695e701b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.353939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12eb2-d5f3-4534-9221-f86d695e701b None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.356548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 57/113] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:23.359006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12eb2-d5f3-4534-9221-f86d695e701b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.377110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12eb2-d5f3-4534-9221-f86d695e701b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.382215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78addb-9054-4fe0-8a71-e7829aad7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.383043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78addb-9054-4fe0-8a71-e7829aad7aae admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.383338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78addb-9054-4fe0-8a71-e7829aad7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.383659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78addb-9054-4fe0-8a71-e7829aad7aae admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.384435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78addb-9054-4fe0-8a71-e7829aad7aae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:23.384745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78addb-9054-4fe0-8a71-e7829aad7aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.387596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78addb-9054-4fe0-8a71-e7829aad7aae admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.398025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 58/114] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:23.399392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd043fd9-0867-4961-a569-a044555dff48 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.399689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd043fd9-0867-4961-a569-a044555dff48 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.399970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd043fd9-0867-4961-a569-a044555dff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.421946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-cd043fd9-0867-4961-a569-a044555dff48 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:23.423577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cd043fd9-0867-4961-a569-a044555dff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:23.432731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 59/115] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:23.433850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd043fd9-0867-4961-a569-a044555dff48 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.450798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 57/116] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:23 2022] PUT /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/5abd0ea4fb81436881102a7e93ae2675/roles/dc6090b70eff456892de81377068fadd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:23.458636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd043fd9-0867-4961-a569-a044555dff48 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.473207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.638996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.641332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.641812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.642279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] PATH_INFO: `/v3/users/9e0166f6ee734994acd210881999ef69` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.647125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e0166f6ee734994acd210881999ef69)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.653373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cf862-3eec-4e30-afca-a6b17ffee15b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.657555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.662705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 60/117] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/users/9e0166f6ee734994acd210881999ef69 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:23.667376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.667784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.672903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.673574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.674040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.706907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314735b7-c1ea-4393-911e-c7ad0e85b472 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.719068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:23.724056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.727428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.727879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.730036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.737935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:23.738242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.739258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 58/118] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:23.740550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.742439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 61/119] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:23.750868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.751117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.768104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367804da-0f8c-4ea4-a37a-73728c19882f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.769191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18165f7a-74ca-4919-9044-69818523e6a4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.777589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.778081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.778485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.778847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.779196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.779796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.780246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:23.780466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.780689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.781050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/9e0166f6ee734994acd210881999ef69/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.784032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.790318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d4a5ac6711498799101bfed49ee0ba, user_id=9e0166f6ee734994acd210881999ef69, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.794110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.808733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 59/120] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:23.815546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.837693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a84e1-c582-4cab-8b36-6db98f277d27 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.850263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.851791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.852236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.852678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.855118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.859397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.862535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 60/121] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:23.870974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.890338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23883f3d-27f5-4d92-872c-194265c91b9c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:23.902631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d177be8-e514-4e69-986e-521d6151dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:23.906579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177be8-e514-4e69-986e-521d6151dbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:23.907781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177be8-e514-4e69-986e-521d6151dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:23.908555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d177be8-e514-4e69-986e-521d6151dbb5 admin admin] PATH_INFO: `/v3/projects/8e142e1c917d4ac69976f5315fcbc459` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:23.911625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 62/122] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:23 2022] PUT /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/9e0166f6ee734994acd210881999ef69/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:00:23.912790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d177be8-e514-4e69-986e-521d6151dbb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e142e1c917d4ac69976f5315fcbc459)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:23.916154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d177be8-e514-4e69-986e-521d6151dbb5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:23.918139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 61/123] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:23 2022] GET /identity/v3/projects/8e142e1c917d4ac69976f5315fcbc459 => generated 312 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:23.925069 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:23.999986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f852ab-bd56-4da4-800e-d717b268f90f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.004938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859335f9-4f34-4f59-8fa2-c793328ef25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.006049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859335f9-4f34-4f59-8fa2-c793328ef25b admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.006396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859335f9-4f34-4f59-8fa2-c793328ef25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.006677 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859335f9-4f34-4f59-8fa2-c793328ef25b admin admin] PATH_INFO: `/v3/projects/8e142e1c917d4ac69976f5315fcbc459/users/5abd0ea4fb81436881102a7e93ae2675/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.008797 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859335f9-4f34-4f59-8fa2-c793328ef25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e142e1c917d4ac69976f5315fcbc459, user_id=5abd0ea4fb81436881102a7e93ae2675, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.011684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859335f9-4f34-4f59-8fa2-c793328ef25b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.081196 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 63/124] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:23 2022] PUT /identity/v3/projects/8e142e1c917d4ac69976f5315fcbc459/users/5abd0ea4fb81436881102a7e93ae2675/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:24.191540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59d2c4-8b9a-4d56-b286-d18d974bbf66 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.191891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59d2c4-8b9a-4d56-b286-d18d974bbf66 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.192112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59d2c4-8b9a-4d56-b286-d18d974bbf66 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.194349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 62/125] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:24.200669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefc0db-7c98-4dba-a7cd-2bca7254b483 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.201280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefc0db-7c98-4dba-a7cd-2bca7254b483 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.201628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefc0db-7c98-4dba-a7cd-2bca7254b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.233091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-edefc0db-7c98-4dba-a7cd-2bca7254b483 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:24.235153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-edefc0db-7c98-4dba-a7cd-2bca7254b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:24.314868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380aa23-b28e-4800-9af6-f797892f77d8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.315603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380aa23-b28e-4800-9af6-f797892f77d8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.315876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380aa23-b28e-4800-9af6-f797892f77d8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.319466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 63/126] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:24.327475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb8eb-6fb0-4e5b-a25f-87d8d04b93a2 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.327950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb8eb-6fb0-4e5b-a25f-87d8d04b93a2 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.328419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cb8eb-6fb0-4e5b-a25f-87d8d04b93a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.396992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0e1cb8eb-6fb0-4e5b-a25f-87d8d04b93a2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:24.398296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0e1cb8eb-6fb0-4e5b-a25f-87d8d04b93a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:24.406611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 64/127] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:24.412807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 64/128] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:24.439874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefc0db-7c98-4dba-a7cd-2bca7254b483 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.447681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb8eb-6fb0-4e5b-a25f-87d8d04b93a2 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.450392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefc0db-7c98-4dba-a7cd-2bca7254b483 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.455407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.456223 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.456504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.456779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.460185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1cb8eb-6fb0-4e5b-a25f-87d8d04b93a2 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.466151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.467270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.467786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.468267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.468715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:24.469942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.471870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.473804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 65/129] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:24.478743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:24.478743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 65/130] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:24.479934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.486773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.499974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83b1b-6d21-4eb3-adea-537550516a1c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.500217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4355b-8ba3-47b7-8366-a3d07f24d640 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.506402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.506927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.507153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.507432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.507763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.508444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.508547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:24.508848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.509281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.509761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.510667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.510910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.513873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.523062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 66/131] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:24.529672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.544524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c4ec-0594-4c63-b6b1-e239a953dfc7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.549520 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.550488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.551058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.551347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] PATH_INFO: `/v3/users/6be259b943034c0987236a5692c3a769` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.572572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=6be259b943034c0987236a5692c3a769)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.575312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.577422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 67/132] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:24 2022] GET /identity/v3/users/6be259b943034c0987236a5692c3a769 => generated 289 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:24.583065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.594060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a922da-75df-4931-bbc0-2da276b2d1a1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.599396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.600141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.600429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.600757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.610861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.612911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.623945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 66/133] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:00:24 2022] POST /identity/v3/projects => generated 302 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:24.628987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 68/134] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:24.630428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.743287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b18104-3cf8-4bbe-8525-99b158ae5d8c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.753756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f422bee-d755-4770-982c-ed2b728e2850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.754607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f422bee-d755-4770-982c-ed2b728e2850 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.754896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f422bee-d755-4770-982c-ed2b728e2850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.755178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f422bee-d755-4770-982c-ed2b728e2850 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.756552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f422bee-d755-4770-982c-ed2b728e2850 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.758686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f422bee-d755-4770-982c-ed2b728e2850 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.760442 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 67/135] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:24 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:24.767403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:24.776627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964e16-6476-41b9-b317-357952b5dfd4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:24.790927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c73311-ce7d-4535-bae9-8bbca93c3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:24.791723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c73311-ce7d-4535-bae9-8bbca93c3564 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:24.792012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c73311-ce7d-4535-bae9-8bbca93c3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:24.792288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c73311-ce7d-4535-bae9-8bbca93c3564 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:24.793197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c73311-ce7d-4535-bae9-8bbca93c3564 admin admin] RBAC: Adding query filter params (role.id=a439ca6f3a8e4e689c96c5715981685a, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=6be259b943034c0987236a5692c3a769) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:24.794291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c73311-ce7d-4535-bae9-8bbca93c3564 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:24.796446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c73311-ce7d-4535-bae9-8bbca93c3564 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:24.807627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 69/136] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:24 2022] GET /identity/v3/role_assignments?user.id=6be259b943034c0987236a5692c3a769&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=a439ca6f3a8e4e689c96c5715981685a => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:26.507969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08565795-0f68-4340-b7cb-f061608dca08 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.508709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08565795-0f68-4340-b7cb-f061608dca08 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.508709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08565795-0f68-4340-b7cb-f061608dca08 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.510398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 68/137] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:26.516391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0c98-c9e6-4f24-8d31-ad6a3109d65e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.517116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0c98-c9e6-4f24-8d31-ad6a3109d65e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.517116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb0c98-c9e6-4f24-8d31-ad6a3109d65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.546676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-81bb0c98-c9e6-4f24-8d31-ad6a3109d65e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:26.548852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-81bb0c98-c9e6-4f24-8d31-ad6a3109d65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:26.558579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 70/138] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:26.603119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08565795-0f68-4340-b7cb-f061608dca08 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:26.627470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08565795-0f68-4340-b7cb-f061608dca08 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:26.637635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:26.638622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.638914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.639193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.655148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:26.662346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:26.663617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 69/139] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:26.669882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb0c98-c9e6-4f24-8d31-ad6a3109d65e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:26.679635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb0c98-c9e6-4f24-8d31-ad6a3109d65e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:26.684899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:26.685599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.685933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.686218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.686971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:26.687282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:26.688933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:26.701784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 71/140] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:26.707142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:26.719147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e0c62-89d7-4774-b7f9-3d2da7e30c07 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:26.729592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:26.730495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.730809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.731614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.733109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:26.735270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:26.737257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 70/141] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:26 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:26.742994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:26.754713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3585b4f-3567-4ffb-93b9-941dec48508d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:26.765800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:26.766388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.766676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.766957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.785210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:26.786986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:26.803616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 72/142] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:26.809600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:26.827483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff4818-ba0d-45af-9f04-4fc7f33897ec admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:26.835641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e01ae9-039c-4550-bf62-b5b4d1ee3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:26.836514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01ae9-039c-4550-bf62-b5b4d1ee3528 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.836796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01ae9-039c-4550-bf62-b5b4d1ee3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.837038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01ae9-039c-4550-bf62-b5b4d1ee3528 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.841831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e01ae9-039c-4550-bf62-b5b4d1ee3528 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:26.843981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e01ae9-039c-4550-bf62-b5b4d1ee3528 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:26.846011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 71/143] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:26 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:26.851692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:26.866692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d2bbf-0df6-4999-87ce-f2a7413d4f5c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:26.877635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4e818-9834-4e00-94ae-0384f45c6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:26.878466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e818-9834-4e00-94ae-0384f45c6734 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:26.878754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e818-9834-4e00-94ae-0384f45c6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:26.879084 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4e818-9834-4e00-94ae-0384f45c6734 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:26.879928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4e818-9834-4e00-94ae-0384f45c6734 admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=5abd0ea4fb81436881102a7e93ae2675) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:26.880240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4e818-9834-4e00-94ae-0384f45c6734 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:26.882139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4e818-9834-4e00-94ae-0384f45c6734 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:26.894181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 73/144] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:26 2022] GET /identity/v3/role_assignments?user.id=5abd0ea4fb81436881102a7e93ae2675&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:27.517038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86047bb-815b-4777-98b8-3a988322d464 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.517978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86047bb-815b-4777-98b8-3a988322d464 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.517978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86047bb-815b-4777-98b8-3a988322d464 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.519302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 72/145] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:27.534873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc39e-b8e1-4ea2-b07d-01f0fe33745b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.535747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc39e-b8e1-4ea2-b07d-01f0fe33745b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.535747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc39e-b8e1-4ea2-b07d-01f0fe33745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.562222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c9ebc39e-b8e1-4ea2-b07d-01f0fe33745b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:27.563439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c9ebc39e-b8e1-4ea2-b07d-01f0fe33745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:27.575364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 74/146] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:27.618558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86047bb-815b-4777-98b8-3a988322d464 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:27.635806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86047bb-815b-4777-98b8-3a988322d464 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:27.642875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:27.643686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.643955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.644226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.658543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:27.666030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:27.667262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 73/147] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:27.673796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebc39e-b8e1-4ea2-b07d-01f0fe33745b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:27.686433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebc39e-b8e1-4ea2-b07d-01f0fe33745b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:27.692500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:27.693214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.693507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.693790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.694553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:27.694862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:27.696471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:27.708954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 75/148] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:27.714409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:27.725231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad503022-f2f1-4e0d-8356-3273758b94b1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:27.737929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:27.738856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.739145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.739424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.740853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:27.743094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:27.745064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 74/149] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:27 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:27.750573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:27.765823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d027b-ebc9-4a90-bcb0-ce7966386eb6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:27.773747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:27.774339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.774641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.774965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.794201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:27.795994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:27.811767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 76/150] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:27.819933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:27.841525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649deb7-cc7a-420b-8d5c-d26ff6e2a56f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:27.858452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eefa2e-0209-4d34-b26d-343b53bbfe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:27.859336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefa2e-0209-4d34-b26d-343b53bbfe78 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.859621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefa2e-0209-4d34-b26d-343b53bbfe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.859891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefa2e-0209-4d34-b26d-343b53bbfe78 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.861819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eefa2e-0209-4d34-b26d-343b53bbfe78 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:27.863903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eefa2e-0209-4d34-b26d-343b53bbfe78 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:27.865725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 75/151] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:27 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:27.871650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:27.886559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b57ae-f185-422b-977d-e60a7b685c98 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:27.904812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656de87-22d4-4f6a-874c-17052e30a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:27.907702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656de87-22d4-4f6a-874c-17052e30a975 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:27.907702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656de87-22d4-4f6a-874c-17052e30a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:27.907702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656de87-22d4-4f6a-874c-17052e30a975 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:27.909391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656de87-22d4-4f6a-874c-17052e30a975 admin admin] RBAC: Adding query filter params (role.id=dc6090b70eff456892de81377068fadd, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=5abd0ea4fb81436881102a7e93ae2675) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:27.910237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656de87-22d4-4f6a-874c-17052e30a975 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:27.918350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656de87-22d4-4f6a-874c-17052e30a975 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:27.931368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 77/152] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:27 2022] GET /identity/v3/role_assignments?user.id=5abd0ea4fb81436881102a7e93ae2675&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=dc6090b70eff456892de81377068fadd => generated 608 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:28.411589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74031a05-fb96-43b0-8b87-fcf76a9f4a4f None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.412076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74031a05-fb96-43b0-8b87-fcf76a9f4a4f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.412496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74031a05-fb96-43b0-8b87-fcf76a9f4a4f None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.415886 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 76/153] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:28.426332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d90e0-2178-4bd4-b7a2-4ce3d712fd0a None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.426803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d90e0-2178-4bd4-b7a2-4ce3d712fd0a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.427294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d90e0-2178-4bd4-b7a2-4ce3d712fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.465139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-741d90e0-2178-4bd4-b7a2-4ce3d712fd0a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:28.467489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-741d90e0-2178-4bd4-b7a2-4ce3d712fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:28.481263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 78/154] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:28.530666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74031a05-fb96-43b0-8b87-fcf76a9f4a4f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.551218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74031a05-fb96-43b0-8b87-fcf76a9f4a4f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.556518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.557361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.557649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.557919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.572943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:28.580709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:28.582012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 77/155] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:28.587912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d90e0-2178-4bd4-b7a2-4ce3d712fd0a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.601888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d90e0-2178-4bd4-b7a2-4ce3d712fd0a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.611101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.611806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.612091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.612369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.613169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:28.613479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.615112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.627660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 79/156] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:28.633303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.647634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5b0bc-d5da-4c65-a0e6-c62f6abfc373 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.654421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddb223-1a71-40a7-bb54-069b1099daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.655894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb223-1a71-40a7-bb54-069b1099daf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.656256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb223-1a71-40a7-bb54-069b1099daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.656539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb223-1a71-40a7-bb54-069b1099daf8 admin admin] PATH_INFO: `/v3/users/5abd0ea4fb81436881102a7e93ae2675` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.660431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddb223-1a71-40a7-bb54-069b1099daf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=5abd0ea4fb81436881102a7e93ae2675)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.663384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddb223-1a71-40a7-bb54-069b1099daf8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.665271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 78/157] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/users/5abd0ea4fb81436881102a7e93ae2675 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:28.671952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.685677 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058c06e-aefa-4ce0-95d9-e09aef24b996 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.691092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fddab-dee3-44f3-aa5a-02be5a279f1f None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.691411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fddab-dee3-44f3-aa5a-02be5a279f1f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.691651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fddab-dee3-44f3-aa5a-02be5a279f1f None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.693996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.694143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 79/158] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:28.694337 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.695657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.695657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.702117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf000-fe84-4b6c-81cd-036efd98e97d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.702774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf000-fe84-4b6c-81cd-036efd98e97d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.703255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf000-fe84-4b6c-81cd-036efd98e97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.707423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.709435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.720684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 80/159] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:28.730167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.732405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0b5cf000-fe84-4b6c-81cd-036efd98e97d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:28.735084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0b5cf000-fe84-4b6c-81cd-036efd98e97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:28.738880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbc41a-a112-4ef5-89de-41b97f2bdf24 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.743998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f773cb5-174a-4d47-9dbd-069388e6254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.744925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773cb5-174a-4d47-9dbd-069388e6254a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.745352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773cb5-174a-4d47-9dbd-069388e6254a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.745631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773cb5-174a-4d47-9dbd-069388e6254a admin admin] PATH_INFO: `/v3/projects/8e142e1c917d4ac69976f5315fcbc459` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.746927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f773cb5-174a-4d47-9dbd-069388e6254a admin admin] RBAC: Authorizing `identity:get_project(project_id=8e142e1c917d4ac69976f5315fcbc459)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.747226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 80/160] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:28.748621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7c95-6988-46b5-a340-11ecdc18e492 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.748919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7c95-6988-46b5-a340-11ecdc18e492 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.749318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece7c95-6988-46b5-a340-11ecdc18e492 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.749519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f773cb5-174a-4d47-9dbd-069388e6254a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.751476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 81/161] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:28.751778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 81/162] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/projects/8e142e1c917d4ac69976f5315fcbc459 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:28.757488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7c95-6988-46b5-a340-11ecdc18e492 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.767736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bec0-677d-4b07-a66e-7f673ac3cf71 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.768371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bec0-677d-4b07-a66e-7f673ac3cf71 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.768844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bec0-677d-4b07-a66e-7f673ac3cf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.771849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece7c95-6988-46b5-a340-11ecdc18e492 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.776638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.777344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.777644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.778985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.778985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=8e142e1c917d4ac69976f5315fcbc459, user.id=5abd0ea4fb81436881102a7e93ae2675) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:28.779397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.783352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.793231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 82/163] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/role_assignments?user.id=5abd0ea4fb81436881102a7e93ae2675&scope.project.id=8e142e1c917d4ac69976f5315fcbc459&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:28.794650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.798941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-1547bec0-677d-4b07-a66e-7f673ac3cf71 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:28.801888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1547bec0-677d-4b07-a66e-7f673ac3cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:28.814284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41557-d1a4-4f01-9ca4-e1710da6c76f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.821472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 82/164] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:28.824229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.826421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.826986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.827480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.849859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:28.859505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bec0-677d-4b07-a66e-7f673ac3cf71 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.864037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:28.866676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 83/165] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:28.875415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.875657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bec0-677d-4b07-a66e-7f673ac3cf71 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.882742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.884215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.884844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.885515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.886210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef06b3b-27d0-448a-a6f2-11d5c23a10bf admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.892138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.892832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.893145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.893430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.894568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:28.894883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.896952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.909413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 84/166] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:28.909789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:28.915130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.925360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:28.927231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb083e8-a5af-41a2-befa-983d991869a3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.928220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 83/167] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:28.934204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.934204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.934204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.934732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] PATH_INFO: `/v3/users/9e0166f6ee734994acd210881999ef69` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.936482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=9e0166f6ee734994acd210881999ef69)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.938651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.940481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 85/168] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/users/9e0166f6ee734994acd210881999ef69 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:28.941356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.946341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.957834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774bba9-ad61-42bd-99c9-1a8f5ca245e4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.959553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927bf5-eba2-4c02-8aff-158e604f76c2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:28.962929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.963856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.964283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.964729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.964840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:28.966104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:28.966387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:28.966622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:28.966858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:28.967414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.969394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.977262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:28.980234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:28.982265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 84/169] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:28.989462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:28.995908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 86/170] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:29.001980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:29.002778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca952d-f0b3-4a99-a2ca-27fed3b7ee54 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:29.008028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:29.009461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.009991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.010511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] PATH_INFO: `/v3/users/6be259b943034c0987236a5692c3a769` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.012149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a63e5-3164-4368-a974-474d040fa745 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:29.012534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] RBAC: Authorizing `identity:get_user(user_id=6be259b943034c0987236a5692c3a769)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:29.015064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:29.017141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:29.017679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 85/171] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:28 2022] GET /identity/v3/users/6be259b943034c0987236a5692c3a769 => generated 289 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:29.022068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.022665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.023790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:29.024569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.030592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:29.035008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:29.038978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 87/172] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:29 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:29.041760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40536152-99e3-4515-bf90-2a2ed0e6cfeb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:29.048498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:29.050712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:29.051955 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.052353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.052753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.054183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:29.056411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:29.058402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 86/173] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:29 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:29.062689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211bd2-a615-4aca-9526-ebea8b8bd711 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:29.065263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:29.070754 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642c06-fb58-478c-8cc8-553ffa1b24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:29.071821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642c06-fb58-478c-8cc8-553ffa1b24d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.072284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642c06-fb58-478c-8cc8-553ffa1b24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.072734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642c06-fb58-478c-8cc8-553ffa1b24d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.074112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642c06-fb58-478c-8cc8-553ffa1b24d6 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=9e0166f6ee734994acd210881999ef69) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:29.075101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642c06-fb58-478c-8cc8-553ffa1b24d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:29.078480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d6cc0-8828-4fbb-ab00-2c1b03a475fd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:29.079568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642c06-fb58-478c-8cc8-553ffa1b24d6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:29.083873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:29.084929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.085381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.085739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/6be259b943034c0987236a5692c3a769/roles/a439ca6f3a8e4e689c96c5715981685a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.087900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d4a5ac6711498799101bfed49ee0ba, user_id=6be259b943034c0987236a5692c3a769, role_id=a439ca6f3a8e4e689c96c5715981685a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:29.088279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 88/174] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:29 2022] GET /identity/v3/role_assignments?user.id=9e0166f6ee734994acd210881999ef69&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:29.092226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:29.112658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c702-a17f-463d-9bb6-b1d7c6381f20 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.112946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c702-a17f-463d-9bb6-b1d7c6381f20 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.113274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c702-a17f-463d-9bb6-b1d7c6381f20 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.115245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 89/175] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:29.122005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5912e-ed7d-4c38-bc65-2588e8374de2 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.122542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5912e-ed7d-4c38-bc65-2588e8374de2 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.122878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5912e-ed7d-4c38-bc65-2588e8374de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.147890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0ff5912e-ed7d-4c38-bc65-2588e8374de2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:29.149273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0ff5912e-ed7d-4c38-bc65-2588e8374de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:29.159029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 90/176] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:29.182034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 87/177] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:29 2022] PUT /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba/users/6be259b943034c0987236a5692c3a769/roles/a439ca6f3a8e4e689c96c5715981685a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:00:29.185862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5912e-ed7d-4c38-bc65-2588e8374de2 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:29.198794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5912e-ed7d-4c38-bc65-2588e8374de2 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:29.275525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71311622-4956-4aaf-8637-312fdcaf310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:29.276267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71311622-4956-4aaf-8637-312fdcaf310e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.276555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71311622-4956-4aaf-8637-312fdcaf310e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.276836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71311622-4956-4aaf-8637-312fdcaf310e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.278504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71311622-4956-4aaf-8637-312fdcaf310e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:29.280347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71311622-4956-4aaf-8637-312fdcaf310e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:29.282183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 91/178] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:29.288155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:29.300303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a658bc4-3eb4-42a6-b77c-eaa7a15de4b4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:29.305656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53e2c9-1ee3-458e-afd1-3d2795de2861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:29.306363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53e2c9-1ee3-458e-afd1-3d2795de2861 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:29.306703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53e2c9-1ee3-458e-afd1-3d2795de2861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:29.306990 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53e2c9-1ee3-458e-afd1-3d2795de2861 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:29.307760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53e2c9-1ee3-458e-afd1-3d2795de2861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:29.308925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-6d53e2c9-1ee3-458e-afd1-3d2795de2861 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:29.308925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:00:29.308925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:00:29.311014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53e2c9-1ee3-458e-afd1-3d2795de2861 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:29.402185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 88/179] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:00:29 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:31.822648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d137c9-4359-4a8d-bccd-58361891053d None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:31.823373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d137c9-4359-4a8d-bccd-58361891053d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:31.823373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d137c9-4359-4a8d-bccd-58361891053d None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:31.826151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 92/180] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:31.832315 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ea12-347d-485b-a211-6f40b552d478 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:31.833119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ea12-347d-485b-a211-6f40b552d478 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:31.833119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942ea12-347d-485b-a211-6f40b552d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:31.853432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5942ea12-347d-485b-a211-6f40b552d478 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:31.854980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5942ea12-347d-485b-a211-6f40b552d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:31.863675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 89/181] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:31.893205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d137c9-4359-4a8d-bccd-58361891053d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:31.906484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d137c9-4359-4a8d-bccd-58361891053d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:31.911182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:31.912004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:31.912290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:31.912571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:31.925028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:31.934784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:31.941258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 93/182] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:31.944837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942ea12-347d-485b-a211-6f40b552d478 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:31.957875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942ea12-347d-485b-a211-6f40b552d478 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:31.962496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:31.963192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:31.963481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:31.963764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:31.964542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:31.964850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:31.967631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:31.977830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 90/183] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:31.985850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:31.996693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcdff9-6dcf-4de4-95e9-83030c9cab9d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.002051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.003003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.003292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.003573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] PATH_INFO: `/v3/users/6be259b943034c0987236a5692c3a769` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.005052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] RBAC: Authorizing `identity:get_user(user_id=6be259b943034c0987236a5692c3a769)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.007461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.009546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 94/184] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:31 2022] GET /identity/v3/users/6be259b943034c0987236a5692c3a769 => generated 289 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.016096 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.026498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0731c2-a494-4211-8ab8-aec781e4670c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.032301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.033025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.033349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.033636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.043909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.046473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.057661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 91/185] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:32.065151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.079976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44fca-c109-4a32-8ec5-9a4dc09ff299 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.086688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52673761-2d8e-4e2f-9ac6-8b9e248a1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.088122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673761-2d8e-4e2f-9ac6-8b9e248a1d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.088561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673761-2d8e-4e2f-9ac6-8b9e248a1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.088969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673761-2d8e-4e2f-9ac6-8b9e248a1d1f admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.091597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52673761-2d8e-4e2f-9ac6-8b9e248a1d1f admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.095427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52673761-2d8e-4e2f-9ac6-8b9e248a1d1f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.104456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 95/186] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.106540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.117365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca8a84-a176-4ea3-80d5-cdfa5b3a5b72 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.122386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716703c-e209-4695-9192-33871d28e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.123190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716703c-e209-4695-9192-33871d28e475 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.123478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716703c-e209-4695-9192-33871d28e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.123758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716703c-e209-4695-9192-33871d28e475 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.124611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716703c-e209-4695-9192-33871d28e475 admin admin] RBAC: Adding query filter params (role.id=a439ca6f3a8e4e689c96c5715981685a, scope.project.id=32d4a5ac6711498799101bfed49ee0ba, user.id=6be259b943034c0987236a5692c3a769) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:32.124926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716703c-e209-4695-9192-33871d28e475 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.126861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716703c-e209-4695-9192-33871d28e475 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.134166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 92/187] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/role_assignments?user.id=6be259b943034c0987236a5692c3a769&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=a439ca6f3a8e4e689c96c5715981685a => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.146949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd758b7-de48-474d-b3e5-eec65f178924 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.147264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd758b7-de48-474d-b3e5-eec65f178924 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.147514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd758b7-de48-474d-b3e5-eec65f178924 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.149497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 96/188] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:32.157711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139682-0551-4a7e-95eb-3a0436706697 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.158064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139682-0551-4a7e-95eb-3a0436706697 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.158276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3139682-0551-4a7e-95eb-3a0436706697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.179699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c3139682-0551-4a7e-95eb-3a0436706697 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:32.181027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c3139682-0551-4a7e-95eb-3a0436706697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:32.189699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 93/189] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:32.225324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd758b7-de48-474d-b3e5-eec65f178924 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.239598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd758b7-de48-474d-b3e5-eec65f178924 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.244365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.245219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.245503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.245776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.259496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:32.267962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:32.269529 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 97/190] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:32.275391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3139682-0551-4a7e-95eb-3a0436706697 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.285476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3139682-0551-4a7e-95eb-3a0436706697 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.295652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.297324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.297910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.298439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.299485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:32.300027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.302409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.314528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 94/191] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.320452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.334820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ae532-9090-4a2b-861f-8c5352fc5606 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.342440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0f7f2-5a0b-4567-aa8b-d9bf53080519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.343765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0f7f2-5a0b-4567-aa8b-d9bf53080519 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.344040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0f7f2-5a0b-4567-aa8b-d9bf53080519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.344319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0f7f2-5a0b-4567-aa8b-d9bf53080519 admin admin] PATH_INFO: `/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.366960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0f7f2-5a0b-4567-aa8b-d9bf53080519 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.372722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0f7f2-5a0b-4567-aa8b-d9bf53080519 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.377541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 98/192] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0 => generated 283 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.384628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.401872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2885e3-2788-47c9-800a-a8bbb1a41c04 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.412818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0eaff-e47f-4367-8360-2a6bd5d74f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.413342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb595-a402-47f8-8d34-3b8fdcc1a9a1 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.413647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb595-a402-47f8-8d34-3b8fdcc1a9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.413934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb595-a402-47f8-8d34-3b8fdcc1a9a1 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.417388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0eaff-e47f-4367-8360-2a6bd5d74f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.417388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0eaff-e47f-4367-8360-2a6bd5d74f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.417388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0eaff-e47f-4367-8360-2a6bd5d74f3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.417610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 99/193] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:32.422988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511b12d-62ab-408b-ac7b-343ed4c3ff9c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.423332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511b12d-62ab-408b-ac7b-343ed4c3ff9c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.423625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511b12d-62ab-408b-ac7b-343ed4c3ff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.431759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0eaff-e47f-4367-8360-2a6bd5d74f3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.433783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0eaff-e47f-4367-8360-2a6bd5d74f3b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.445507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 95/194] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:32.447210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e90d69-dd50-464f-a80c-efd5b780c75c None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.447830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e90d69-dd50-464f-a80c-efd5b780c75c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.448272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e90d69-dd50-464f-a80c-efd5b780c75c None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.450683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 96/195] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:32.454361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e90d69-dd50-464f-a80c-efd5b780c75c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.459314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b511b12d-62ab-408b-ac7b-343ed4c3ff9c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:32.460572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b511b12d-62ab-408b-ac7b-343ed4c3ff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:32.469698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 100/196] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:32.470002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e90d69-dd50-464f-a80c-efd5b780c75c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.471104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08f80-41c7-4b5a-92b1-9f6c507735d0 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.471431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08f80-41c7-4b5a-92b1-9f6c507735d0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.471659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08f80-41c7-4b5a-92b1-9f6c507735d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.477801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.478923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.479595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.479595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.481368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.483493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.485618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 97/197] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:32.494217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.497273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d5b08f80-41c7-4b5a-92b1-9f6c507735d0 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:32.499104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d5b08f80-41c7-4b5a-92b1-9f6c507735d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:32.505835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25522d-7939-4f08-92a2-f1f243ac1854 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.507477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 101/198] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:32.508240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08f80-41c7-4b5a-92b1-9f6c507735d0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.510345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.511007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.511293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.511573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.513359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:32.513686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.515577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.518563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08f80-41c7-4b5a-92b1-9f6c507735d0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.521566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 98/199] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/role_assignments?user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.523179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.523999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.524284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.524563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.525928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.528709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.530844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 102/200] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.536463 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.537232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.547816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3dc05-82d3-471a-9a88-e0483fed2609 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.548157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb93f-c243-492f-aad4-ebb89bd73686 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.553166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.553388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.554057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.554168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.554345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.554436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.554615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.554707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.555610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.557713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.568865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:32.577551 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:32.579151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 103/201] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:32.586067 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.598736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14dac0-7b23-40a1-92ef-0348ae37f36c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.603651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.604500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.604681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.604957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.605926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:32.606342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.608373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.618033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 104/202] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:32.624742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.635313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69d6ee-f0ef-4b0c-8dca-a0569cf33395 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.640832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.641784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.642067 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.642343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] PATH_INFO: `/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.643693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.645955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.648001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 105/203] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:32.653937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.664857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c5130-50df-46b4-9a35-08ca673457d2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.672508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 99/204] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:00:32 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:32.679160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.679959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.680322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.680676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.691119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.693371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.710344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 106/205] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:32.711814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.726366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e9c29-482a-43f4-8bde-f204529d3dd4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.731205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223751-59c2-4c02-9edb-f89a4a822e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.732679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223751-59c2-4c02-9edb-f89a4a822e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.733329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223751-59c2-4c02-9edb-f89a4a822e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.733758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223751-59c2-4c02-9edb-f89a4a822e59 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.736227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46223751-59c2-4c02-9edb-f89a4a822e59 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.738641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46223751-59c2-4c02-9edb-f89a4a822e59 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.740993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 100/206] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:32.748006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:32.758126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74b031-83c2-4360-8a37-7dc05a911a72 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:32.763439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b19a5-0b8c-43bf-905d-d191596d6c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:32.764156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b19a5-0b8c-43bf-905d-d191596d6c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:32.764444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b19a5-0b8c-43bf-905d-d191596d6c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:32.764725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b19a5-0b8c-43bf-905d-d191596d6c22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:32.765679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b19a5-0b8c-43bf-905d-d191596d6c22 admin admin] RBAC: Adding query filter params (role.id=dc6090b70eff456892de81377068fadd, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:32.766001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b19a5-0b8c-43bf-905d-d191596d6c22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:32.767926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b19a5-0b8c-43bf-905d-d191596d6c22 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:32.774580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 107/207] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:32 2022] GET /identity/v3/role_assignments?user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=dc6090b70eff456892de81377068fadd => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:35.005592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42535-d2a4-4db5-b40c-ae89a92a552f None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.007176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42535-d2a4-4db5-b40c-ae89a92a552f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.007944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f42535-d2a4-4db5-b40c-ae89a92a552f None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.011767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 101/208] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:35.018376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d740d-2971-45e3-94a8-d4df8610af91 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.019092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d740d-2971-45e3-94a8-d4df8610af91 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.019092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d740d-2971-45e3-94a8-d4df8610af91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.039476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-bf1d740d-2971-45e3-94a8-d4df8610af91 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:35.040684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bf1d740d-2971-45e3-94a8-d4df8610af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:35.053204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 108/209] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:35.077656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42535-d2a4-4db5-b40c-ae89a92a552f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.090261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f42535-d2a4-4db5-b40c-ae89a92a552f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.095176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.095981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.096267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.096544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.109209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:35.116487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:35.117785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 102/210] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:35.128273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d740d-2971-45e3-94a8-d4df8610af91 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.138911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d740d-2971-45e3-94a8-d4df8610af91 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.143617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.144315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.144603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.144885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.145695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:35.146008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:35.147666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:35.158169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 109/211] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:35.163954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.176309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc07b1-23dd-4f05-a6b9-0c436393f63c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.180927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.181847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.182135 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.182415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] PATH_INFO: `/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.183641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:35.186309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:35.192435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 103/212] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:35 2022] GET /identity/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:35.195519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.206450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f345dae-7317-41bd-90a0-5ab2cf32ed54 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.210921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de3ba-b834-4384-a51d-5a753e095e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.211780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de3ba-b834-4384-a51d-5a753e095e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.212068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de3ba-b834-4384-a51d-5a753e095e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.212346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de3ba-b834-4384-a51d-5a753e095e4e admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.216686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168de3ba-b834-4384-a51d-5a753e095e4e admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:35.216686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168de3ba-b834-4384-a51d-5a753e095e4e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:35.223137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 110/213] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:35 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:35.224479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.235285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362da3-f6b9-45b7-ae91-231d92d0f584 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.239686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a227-eb22-4bb4-929c-9079afdca1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.240567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a227-eb22-4bb4-929c-9079afdca1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.240853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a227-eb22-4bb4-929c-9079afdca1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.241153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a227-eb22-4bb4-929c-9079afdca1e8 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.243132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a227-eb22-4bb4-929c-9079afdca1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7aefae5004978a40b0657cb85a6c5, user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:35.245814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a227-eb22-4bb4-929c-9079afdca1e8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:35.337362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 104/214] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:35 2022] PUT /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:35.530268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38c23-78c8-4946-b522-16845ed996c1 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.530956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38c23-78c8-4946-b522-16845ed996c1 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.531441 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d38c23-78c8-4946-b522-16845ed996c1 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.533565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 111/215] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:35.541170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ebc1a-0e96-4171-8b94-dcf597b9ae2b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.541792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ebc1a-0e96-4171-8b94-dcf597b9ae2b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.542299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ebc1a-0e96-4171-8b94-dcf597b9ae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.564781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-136ebc1a-0e96-4171-8b94-dcf597b9ae2b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:35.566371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-136ebc1a-0e96-4171-8b94-dcf597b9ae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:35.636544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 105/216] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:35.676607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38c23-78c8-4946-b522-16845ed996c1 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.693008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d38c23-78c8-4946-b522-16845ed996c1 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.697897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed20c1-fc4a-42de-81f9-7eec820db29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.698926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed20c1-fc4a-42de-81f9-7eec820db29e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.700416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed20c1-fc4a-42de-81f9-7eec820db29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.700904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed20c1-fc4a-42de-81f9-7eec820db29e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.702352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed20c1-fc4a-42de-81f9-7eec820db29e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:35.704252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed20c1-fc4a-42de-81f9-7eec820db29e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:35.706145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 112/217] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:35.711738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ebc1a-0e96-4171-8b94-dcf597b9ae2b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.721435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ebc1a-0e96-4171-8b94-dcf597b9ae2b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.726237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.727170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.727681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.728154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.729119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:35.731718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:35.826683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77ceb-52a7-4319-8dda-9b99c896c8bf None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.827432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77ceb-52a7-4319-8dda-9b99c896c8bf None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.827685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e77ceb-52a7-4319-8dda-9b99c896c8bf None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.831482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 113/218] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:35.839002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a006d-ba6f-4d7d-9984-6ccd2bdcaf97 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.839498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a006d-ba6f-4d7d-9984-6ccd2bdcaf97 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.839990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a006d-ba6f-4d7d-9984-6ccd2bdcaf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.874095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-554a006d-ba6f-4d7d-9984-6ccd2bdcaf97 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:35.876209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-554a006d-ba6f-4d7d-9984-6ccd2bdcaf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:35.892939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 106/219] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:00:35 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:35.893402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 114/220] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:35.923799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:35.944637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2598-d3c6-40c5-9996-1a883573891a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:35.953270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:35.954721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.955359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.955868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.977144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:35.982448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5fabb-fc56-482e-8a26-5f87a572e8c0 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.983179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5fabb-fc56-482e-8a26-5f87a572e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.983661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5fabb-fc56-482e-8a26-5f87a572e8c0 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:35.985843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 115/221] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:35.991655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:35.993794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 107/222] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:35.994700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f289a-f341-423c-aafa-64f58ba38f3b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:35.995095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f289a-f341-423c-aafa-64f58ba38f3b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:35.995473 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f289a-f341-423c-aafa-64f58ba38f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.007055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.023388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-fe6f289a-f341-423c-aafa-64f58ba38f3b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:36.025054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fe6f289a-f341-423c-aafa-64f58ba38f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:36.029572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e496-a9d0-4aa4-b5e1-88d6751b6a62 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.035119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 116/223] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:36.040138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.043790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.044843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.045793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.047889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:36.048764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.052885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.071163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 108/224] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:36.077172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f289a-f341-423c-aafa-64f58ba38f3b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.080886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.087634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f289a-f341-423c-aafa-64f58ba38f3b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.094181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.095085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.095554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.095992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] PATH_INFO: `/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.097428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.099476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b12aa-99ec-4fa4-827c-1b939bcce07b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.099644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.102056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 117/225] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:36.109118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.110130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.110963 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.111247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.111522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.120317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62e9ab-5141-468c-a5c9-4907014d3a36 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.125694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:36.126313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.127336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.127804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.128145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.130140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.133403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:36.134708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.135008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 109/226] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:36.138459 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 118/227] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:36.145706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.150902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.161699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3a639-8b40-4322-8d43-b5be288fa35f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.165429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b6e8c-2ab8-4936-977e-2a6b120982b0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.173665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.174069 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.174335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.174649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.175394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:36.175726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.176760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.177742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.178406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.178982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.179725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0/roles/dc6090b70eff456892de81377068fadd` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.186915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7aefae5004978a40b0657cb85a6c5, user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0, role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.189248 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 110/228] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:36.191993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.196202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.207321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77252cff-eea8-4277-b3b5-25bc5380d072 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.212192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.213596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.213596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.213944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] PATH_INFO: `/v3/users/c8463bb729374799bf647b6b3bd41265` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.231056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=c8463bb729374799bf647b6b3bd41265)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.233579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.235569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 111/229] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/users/c8463bb729374799bf647b6b3bd41265 => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:36.240788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.255366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc78-ccd5-48c3-8bcc-c5655e7324e5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.259910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.260571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.260927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.261252 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.271217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.272993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.273610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 119/230] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:36 2022] PUT /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0/roles/dc6090b70eff456892de81377068fadd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:00:36.289691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 112/231] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:36.296323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.368585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc7681-05b0-4c50-8e11-4844831dfbd0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.374480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba7f8a-97d2-47aa-a32a-c3d499960207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.375601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba7f8a-97d2-47aa-a32a-c3d499960207 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.375960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba7f8a-97d2-47aa-a32a-c3d499960207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.376237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba7f8a-97d2-47aa-a32a-c3d499960207 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.377568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba7f8a-97d2-47aa-a32a-c3d499960207 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.379667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba7f8a-97d2-47aa-a32a-c3d499960207 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.381543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 120/232] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:36.388322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:36.398660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212c40b-ca02-407c-9b9d-ea78c8ac4821 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:36.403978 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c0515-8217-4e7c-89e1-e23d10abb97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:36.404723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c0515-8217-4e7c-89e1-e23d10abb97d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:36.405039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c0515-8217-4e7c-89e1-e23d10abb97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:36.405360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c0515-8217-4e7c-89e1-e23d10abb97d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:36.406228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c0515-8217-4e7c-89e1-e23d10abb97d admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=c8463bb729374799bf647b6b3bd41265) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:36.406523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c0515-8217-4e7c-89e1-e23d10abb97d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:36.408393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c0515-8217-4e7c-89e1-e23d10abb97d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:36.414902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 113/233] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:36 2022] GET /identity/v3/role_assignments?user.id=c8463bb729374799bf647b6b3bd41265&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:38.287394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa37ab-bd52-4146-8105-cf5503f5a3cf None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.287896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa37ab-bd52-4146-8105-cf5503f5a3cf None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.287967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa37ab-bd52-4146-8105-cf5503f5a3cf None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.289879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 121/234] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:38.306902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ef067-b361-4425-8d5e-7f72218238af None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.307406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ef067-b361-4425-8d5e-7f72218238af None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.307478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ef067-b361-4425-8d5e-7f72218238af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.334356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0f7ef067-b361-4425-8d5e-7f72218238af None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:38.335628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0f7ef067-b361-4425-8d5e-7f72218238af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:38.344244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 114/235] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:38.376806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa37ab-bd52-4146-8105-cf5503f5a3cf None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:38.394725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa37ab-bd52-4146-8105-cf5503f5a3cf None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:38.401671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:38.402850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.402850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.403176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.426704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:38.439627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:38.445892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 122/236] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:38.452358 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ef067-b361-4425-8d5e-7f72218238af None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:38.464198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ef067-b361-4425-8d5e-7f72218238af None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:38.478840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:38.479592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.479881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.480154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.481501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:38.481803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:38.483385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:38.500473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 115/237] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:38.506589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:38.527590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388398e-f9dd-4ab4-8a5d-1a309d9169b1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:38.542097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:38.543540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.543992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.544487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] PATH_INFO: `/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.546499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] RBAC: Authorizing `identity:get_user(user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:38.550273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:38.553696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 123/238] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:38 2022] GET /identity/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0 => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:38.558532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:38.574922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522e52f-0c2b-435f-b67c-c98cff214e61 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:38.583355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:38.584003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.584283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.584556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.601054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:38.602819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:38.619184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 116/239] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:38.625546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:38.640917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e7dd-118c-41f7-88aa-1a1e50f2de54 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:38.649237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180d46-f65a-4cde-87e3-6f127a419ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:38.650396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180d46-f65a-4cde-87e3-6f127a419ace admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.650862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180d46-f65a-4cde-87e3-6f127a419ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.651314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180d46-f65a-4cde-87e3-6f127a419ace admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.653621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180d46-f65a-4cde-87e3-6f127a419ace admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:38.656323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180d46-f65a-4cde-87e3-6f127a419ace admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:38.658290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 124/240] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:38 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:38.664180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:38.674915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2399e-fd64-47d7-8cfd-ddcaef7487f3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:38.689822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f944058-b502-4da2-873e-b39c9dc09169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:38.690501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944058-b502-4da2-873e-b39c9dc09169 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:38.690785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944058-b502-4da2-873e-b39c9dc09169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:38.691064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944058-b502-4da2-873e-b39c9dc09169 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:38.691901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f944058-b502-4da2-873e-b39c9dc09169 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:38.692210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f944058-b502-4da2-873e-b39c9dc09169 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:38.694194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f944058-b502-4da2-873e-b39c9dc09169 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:38.702708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 117/241] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:38 2022] GET /identity/v3/role_assignments?user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:39.366671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f279e-cd74-44ab-befb-1740acd6f460 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.367587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f279e-cd74-44ab-befb-1740acd6f460 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.367962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f279e-cd74-44ab-befb-1740acd6f460 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.370329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 125/242] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:39.378167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a469-34d1-4357-971e-15fd196dc181 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.378715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a469-34d1-4357-971e-15fd196dc181 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.378715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79a469-34d1-4357-971e-15fd196dc181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.399588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2a79a469-34d1-4357-971e-15fd196dc181 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:39.400801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2a79a469-34d1-4357-971e-15fd196dc181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:39.414430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 118/243] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:39.439592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f279e-cd74-44ab-befb-1740acd6f460 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.455773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f279e-cd74-44ab-befb-1740acd6f460 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.460209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.461017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.461329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.461602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.474419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:39.481917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:39.483417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 126/244] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:39.489514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a469-34d1-4357-971e-15fd196dc181 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.499736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79a469-34d1-4357-971e-15fd196dc181 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.504495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.505223 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.505508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.505786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.506545 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:39.506852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.508449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.518443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 119/245] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:39.523836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.533904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480eb0d-51a2-4a18-b23b-c15fd4ae5a07 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.538442 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca34b3d-e40a-4493-b665-1edb36d7724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.539316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca34b3d-e40a-4493-b665-1edb36d7724c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.539594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca34b3d-e40a-4493-b665-1edb36d7724c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.539868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca34b3d-e40a-4493-b665-1edb36d7724c admin admin] PATH_INFO: `/v3/users/fd7a77a2b41a467f896307a7766b51d2` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.555644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca34b3d-e40a-4493-b665-1edb36d7724c admin admin] RBAC: Authorizing `identity:get_user(user_id=fd7a77a2b41a467f896307a7766b51d2)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.557960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca34b3d-e40a-4493-b665-1edb36d7724c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.560701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 127/246] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/users/fd7a77a2b41a467f896307a7766b51d2 => generated 297 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:39.566265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.577316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cba49-0733-4817-8444-5c929942ba3f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.582859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.583333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eba36-531d-4d23-9485-8f54301f5c8e None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.583513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.583663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eba36-531d-4d23-9485-8f54301f5c8e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.583850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.584004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eba36-531d-4d23-9485-8f54301f5c8e None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.584216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.585701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 128/247] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:39.594815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.595645 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3006a-4920-4ef0-a3a8-d9972f5c6421 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.596112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3006a-4920-4ef0-a3a8-d9972f5c6421 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.596560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3006a-4920-4ef0-a3a8-d9972f5c6421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.596735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.607098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 120/248] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:39.614305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.623274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0dd3006a-4920-4ef0-a3a8-d9972f5c6421 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:39.624489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0dd3006a-4920-4ef0-a3a8-d9972f5c6421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:39.625492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deaddd-cc53-4002-80f0-b65dfbd18d75 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.631480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.632364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.632652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.632917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.633664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 129/249] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:39.634435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.644772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.649161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 121/250] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:39.651142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3006a-4920-4ef0-a3a8-d9972f5c6421 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.661392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3006a-4920-4ef0-a3a8-d9972f5c6421 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.665901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.669725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.670608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.670891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.671166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.672368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] RBAC: Adding query filter params (role.id=a439ca6f3a8e4e689c96c5715981685a, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=fd7a77a2b41a467f896307a7766b51d2) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:39.672682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.675521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.677901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25ea4c-d260-4f6a-837f-c9277bb52689 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.682486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e3b34-1f9a-4e4a-ae84-878f34a4d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.682814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 130/251] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/role_assignments?user.id=fd7a77a2b41a467f896307a7766b51d2&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=a439ca6f3a8e4e689c96c5715981685a => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:39.683632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3b34-1f9a-4e4a-ae84-878f34a4d0bc admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.684514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3b34-1f9a-4e4a-ae84-878f34a4d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.684784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e3b34-1f9a-4e4a-ae84-878f34a4d0bc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.693626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e3b34-1f9a-4e4a-ae84-878f34a4d0bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.696001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e3b34-1f9a-4e4a-ae84-878f34a4d0bc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.698150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 122/252] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:39.705655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.721124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958f394-fe87-414f-bdb4-28d00c041812 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.726344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43781f-abdf-4653-9153-9e69b40f51ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.727415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43781f-abdf-4653-9153-9e69b40f51ee admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.727935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43781f-abdf-4653-9153-9e69b40f51ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.728439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43781f-abdf-4653-9153-9e69b40f51ee admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.729772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43781f-abdf-4653-9153-9e69b40f51ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.732209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43781f-abdf-4653-9153-9e69b40f51ee admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.771760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d5a4-247b-4f4c-8379-3044af6968f0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.771760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d5a4-247b-4f4c-8379-3044af6968f0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.771760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7d5a4-247b-4f4c-8379-3044af6968f0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.771760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 123/253] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:39.778209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19944ab-ae5a-4266-a6ff-bcc049e94054 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.778544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19944ab-ae5a-4266-a6ff-bcc049e94054 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.778880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19944ab-ae5a-4266-a6ff-bcc049e94054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.803096 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c19944ab-ae5a-4266-a6ff-bcc049e94054 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:39.808169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c19944ab-ae5a-4266-a6ff-bcc049e94054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:39.825114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 124/254] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:39.855037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19944ab-ae5a-4266-a6ff-bcc049e94054 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.873346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 131/255] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:00:39 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:39.873680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19944ab-ae5a-4266-a6ff-bcc049e94054 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.884085 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.885657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.886188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.886830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.895057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f3e5-fc17-4594-aa4f-a1a8dd0a8a5e None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.895354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f3e5-fc17-4594-aa4f-a1a8dd0a8a5e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.895636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f3e5-fc17-4594-aa4f-a1a8dd0a8a5e None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.897464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 132/256] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:39.901952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:39.904188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18171c1e-9450-4ec9-8c87-824ba910633f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.904930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18171c1e-9450-4ec9-8c87-824ba910633f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.904930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18171c1e-9450-4ec9-8c87-824ba910633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.910309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:39.912115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 125/257] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:39.919268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.930277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5d6d5-705b-4cc6-b40c-005ab2106a6b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.936725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.937454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.937745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.938027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.938800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:39.939103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.940741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.941267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-18171c1e-9450-4ec9-8c87-824ba910633f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:39.944852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-18171c1e-9450-4ec9-8c87-824ba910633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:39.952349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 126/258] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:39.958530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 133/259] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:39.959690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.975562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff800efc-3517-45e8-b2d2-cf4311eb8f54 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:39.980001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:39.981646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:39.981923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:39.982192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] PATH_INFO: `/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:39.984931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] RBAC: Authorizing `identity:get_user(user_id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:39.987380 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:39.988432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18171c1e-9450-4ec9-8c87-824ba910633f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.991423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 127/260] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/users/a7bd1feb57ba4d2b861d7f7e0bcf6dd0 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:39.999479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:39.999960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18171c1e-9450-4ec9-8c87-824ba910633f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.004795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.005739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.006021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.006292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.014817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ab091-ebc4-4577-90ed-ed819221e49e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.019536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:40.021415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.022310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.022932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.023410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.026781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:40.032782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 134/261] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:40.035493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:40.038509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:40.040305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:40.053139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 128/262] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:40.055290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c57bc-c168-422f-8351-96a52120ea8f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.057272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:40.064937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.066317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.066709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.067163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.068088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:40.068620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:40.068995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77899f-d543-4bc3-8036-b22cc87caf7d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.070821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:40.074284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.075476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.075938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.076405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.078169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:40.080489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:40.082597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 129/263] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:40 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:40.086345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 135/264] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:40.088747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:40.094311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:40.102308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772d605-b625-43c1-9350-08a59b732e29 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.105426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e030e0-e2a5-46ef-8298-38048dcd7f44 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.108496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.109667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.110169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.110764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.111117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.112033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.112168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] RBAC: Adding query filter params (role.id=dc6090b70eff456892de81377068fadd, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:40.112341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:40.113236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.113527 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] PATH_INFO: `/v3/users/c8463bb729374799bf647b6b3bd41265` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.114321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:40.114903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c8463bb729374799bf647b6b3bd41265)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:40.117179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:40.119070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 136/265] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:40 2022] GET /identity/v3/users/c8463bb729374799bf647b6b3bd41265 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:40.124721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:40.126199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 130/266] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:40 2022] GET /identity/v3/role_assignments?user.id=a7bd1feb57ba4d2b861d7f7e0bcf6dd0&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=dc6090b70eff456892de81377068fadd => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:40.135083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e94d0-92c3-4d91-8823-20f13fbfacb1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.140060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2baf-aaaf-49f8-88f1-0121f5438c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.140953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2baf-aaaf-49f8-88f1-0121f5438c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.141271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2baf-aaaf-49f8-88f1-0121f5438c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.141553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2baf-aaaf-49f8-88f1-0121f5438c8f admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.142883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2baf-aaaf-49f8-88f1-0121f5438c8f admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:40.145050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2baf-aaaf-49f8-88f1-0121f5438c8f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:40.147229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 137/267] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:40 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:40.153671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:40.164189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71781793-cade-4808-b99f-708b6c65e40d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:40.170434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1732a3-6fda-4e4e-8d43-d8b6eb36a8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:40.171854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1732a3-6fda-4e4e-8d43-d8b6eb36a8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:40.172133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1732a3-6fda-4e4e-8d43-d8b6eb36a8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:40.172450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1732a3-6fda-4e4e-8d43-d8b6eb36a8ac admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/c8463bb729374799bf647b6b3bd41265/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:40.175418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1732a3-6fda-4e4e-8d43-d8b6eb36a8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7aefae5004978a40b0657cb85a6c5, user_id=c8463bb729374799bf647b6b3bd41265, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:40.178609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1732a3-6fda-4e4e-8d43-d8b6eb36a8ac admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:40.276537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 131/268] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:40 2022] PUT /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/c8463bb729374799bf647b6b3bd41265/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:00:42.522894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd0c57-abdb-4bbd-8580-887c8e1a362b None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.524370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd0c57-abdb-4bbd-8580-887c8e1a362b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.525190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd0c57-abdb-4bbd-8580-887c8e1a362b None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.528760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 138/269] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:42.534728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890fe3-a41f-4211-856b-a4d380cbdbb4 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.535510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890fe3-a41f-4211-856b-a4d380cbdbb4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.535510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890fe3-a41f-4211-856b-a4d380cbdbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.555575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c0890fe3-a41f-4211-856b-a4d380cbdbb4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:42.556785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c0890fe3-a41f-4211-856b-a4d380cbdbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:42.560976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc748c4-a25f-4afa-9950-13f7ed07270d None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.561618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc748c4-a25f-4afa-9950-13f7ed07270d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.562404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc748c4-a25f-4afa-9950-13f7ed07270d None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.565713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 139/270] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:42.571520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a4ee9-3da6-4e9f-894f-17c247467bd4 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.572094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a4ee9-3da6-4e9f-894f-17c247467bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.572572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a4ee9-3da6-4e9f-894f-17c247467bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.593896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-337a4ee9-3da6-4e9f-894f-17c247467bd4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:42.596252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-337a4ee9-3da6-4e9f-894f-17c247467bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:42.622873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 132/271] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:42.648098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890fe3-a41f-4211-856b-a4d380cbdbb4 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.658321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890fe3-a41f-4211-856b-a4d380cbdbb4 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.665206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.666426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.666930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.667421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.669890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:42.672323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:42.674698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 133/272] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:42.681274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.686327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 140/273] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:42.694592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001f05-0ce5-41d4-99e6-099f7fbc50ac admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.699077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.700040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.700350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.700633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.701531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:42.703985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:42.714035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a4ee9-3da6-4e9f-894f-17c247467bd4 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.724620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a4ee9-3da6-4e9f-894f-17c247467bd4 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.729304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.730150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.730436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.731385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.742775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:42.750283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:42.751526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 141/274] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:42.758191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.768792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bc6e0-aa34-44a7-a074-e311d668db57 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.773446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.774062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.774349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.774625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.775385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:42.775687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:42.777346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:42.792804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 142/275] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:42.802234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.802811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 134/276] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:00:42 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:42.818239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daefde-caa7-48cf-a9f8-29af915f511f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.823096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23871480-c33a-4890-8bd5-13c6ca4353b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.823993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23871480-c33a-4890-8bd5-13c6ca4353b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.824275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23871480-c33a-4890-8bd5-13c6ca4353b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.825272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23871480-c33a-4890-8bd5-13c6ca4353b0 admin admin] PATH_INFO: `/v3/users/fd7a77a2b41a467f896307a7766b51d2` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.833096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23871480-c33a-4890-8bd5-13c6ca4353b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd7a77a2b41a467f896307a7766b51d2)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:42.833096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23871480-c33a-4890-8bd5-13c6ca4353b0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:42.833096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 143/277] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/users/fd7a77a2b41a467f896307a7766b51d2 => generated 297 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:42.837630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.842339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ab25-99e0-4e87-8f00-ceccc0cba9df None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.842669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ab25-99e0-4e87-8f00-ceccc0cba9df None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.842906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6ab25-99e0-4e87-8f00-ceccc0cba9df None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.849007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 144/278] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:42.849219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a333838-02a5-4263-b796-8bbe2f7af675 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.850928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe449c0-b969-498f-b81a-c5c3a8566f58 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.851292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe449c0-b969-498f-b81a-c5c3a8566f58 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.851644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe449c0-b969-498f-b81a-c5c3a8566f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.854063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.854945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.855229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.855506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.856801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:42.859488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:42.861740 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 135/279] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:42.867383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.873237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-3fe449c0-b969-498f-b81a-c5c3a8566f58 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:42.874685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3fe449c0-b969-498f-b81a-c5c3a8566f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:42.878325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d2443-de2c-4381-8e66-a1bec45daa7f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.883219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.885224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.885224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.885224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/fd7a77a2b41a467f896307a7766b51d2/roles/a439ca6f3a8e4e689c96c5715981685a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.887621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7aefae5004978a40b0657cb85a6c5, user_id=fd7a77a2b41a467f896307a7766b51d2, role_id=a439ca6f3a8e4e689c96c5715981685a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:42.889775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 145/280] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:42.890541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:42.891421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30e71-cb11-40fe-b202-08537a60083a None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.893886 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30e71-cb11-40fe-b202-08537a60083a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.893886 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c30e71-cb11-40fe-b202-08537a60083a None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.894218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 146/281] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:42.907042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0199-118b-4fb7-afbb-efb4aa618af2 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.907530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0199-118b-4fb7-afbb-efb4aa618af2 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.907670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0199-118b-4fb7-afbb-efb4aa618af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.927693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-daff0199-118b-4fb7-afbb-efb4aa618af2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:42.930362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-daff0199-118b-4fb7-afbb-efb4aa618af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:42.937221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 147/282] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:42.939332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0199-118b-4fb7-afbb-efb4aa618af2 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.949598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0199-118b-4fb7-afbb-efb4aa618af2 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:42.954745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:42.955562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:42.959756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:42.959756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:42.969281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:42.977114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:42.979385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 148/283] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:42.982303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.987277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 136/284] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:00:42 2022] PUT /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5/users/fd7a77a2b41a467f896307a7766b51d2/roles/a439ca6f3a8e4e689c96c5715981685a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:00:42.997150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:42.997382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140c6f7-2a64-41f2-bd70-df9dc8667115 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.071645 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.072437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.072730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.073012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.082752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548246-9466-4e5e-a7db-36071960a579 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.087610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:43.096214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:43.097280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.097524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 149/285] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:43.098521 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.099009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.099447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.100404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:43.100877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.103873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:43.104055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.114753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 137/286] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:43.122044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:43.122640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97414e3-f214-4fa1-ab29-995603faf519 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.127590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.128497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.128784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.129061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.130170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:43.130481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.132856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.136487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb8f94-e8cb-4a22-9874-7050d8b1e635 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.142858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.144210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.144847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.145368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] PATH_INFO: `/v3/users/c8463bb729374799bf647b6b3bd41265` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.145611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 150/287] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:43.147441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] RBAC: Authorizing `identity:get_user(user_id=c8463bb729374799bf647b6b3bd41265)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.150153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.151151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:43.153393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 138/288] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:43 2022] GET /identity/v3/users/c8463bb729374799bf647b6b3bd41265 => generated 297 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:43.159263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:43.164729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1575483-0121-4964-a280-8faae127e57e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.171105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e6904-3f43-48d0-a8c2-e79a6bfbd336 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.171669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.172835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.173391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.173832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] PATH_INFO: `/v3/users/9c7dae9069074be49804342c84163c98` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.177631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.178998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.178998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.178998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.191524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.194305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.201110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] RBAC: Authorizing `identity:get_user(user_id=9c7dae9069074be49804342c84163c98)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.203306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.205373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 151/289] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:43 2022] GET /identity/v3/users/9c7dae9069074be49804342c84163c98 => generated 293 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:43.206905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 139/290] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:43.213415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:43.220802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:43.225835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5621dc-034a-406d-a565-14aa896b1fab admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.232099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.232854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.233244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.233529 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.234464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, user.id=9c7dae9069074be49804342c84163c98, scope.system=all) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:43.234849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.236790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.236956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a0c66-c62b-401e-8603-92ab618f63d0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.242880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e856f22-78e3-4e97-b3c8-b2b3aca6fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.244148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856f22-78e3-4e97-b3c8-b2b3aca6fe3b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.244661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856f22-78e3-4e97-b3c8-b2b3aca6fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.245017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856f22-78e3-4e97-b3c8-b2b3aca6fe3b admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.246034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 152/291] 10.222.0.87 () {56 vars in 1329 bytes} [Wed Feb 16 18:00:43 2022] GET /identity/v3/role_assignments?user.id=9c7dae9069074be49804342c84163c98&scope.system=all&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:43.247321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856f22-78e3-4e97-b3c8-b2b3aca6fe3b admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.253164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856f22-78e3-4e97-b3c8-b2b3aca6fe3b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.253164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 140/292] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:43 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:43.257668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:43.271138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bd4fc-6491-4dcc-8a1b-dcadf739876a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:43.275958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeb0f4-0c92-460b-afeb-647614778f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:43.276732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeb0f4-0c92-460b-afeb-647614778f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:43.277143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeb0f4-0c92-460b-afeb-647614778f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:43.278138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeb0f4-0c92-460b-afeb-647614778f13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:43.278977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeb0f4-0c92-460b-afeb-647614778f13 admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=c8463bb729374799bf647b6b3bd41265) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:43.279470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeb0f4-0c92-460b-afeb-647614778f13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:43.281539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeb0f4-0c92-460b-afeb-647614778f13 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:43.288602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 153/293] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:43 2022] GET /identity/v3/role_assignments?user.id=c8463bb729374799bf647b6b3bd41265&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:45.532302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e50f-65b8-48d7-9203-2405e777a44e None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.532813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e50f-65b8-48d7-9203-2405e777a44e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.533152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817e50f-65b8-48d7-9203-2405e777a44e None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.536231 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 141/294] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:45.541827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33652842-967b-4683-8444-1b32bcc25d06 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.542248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33652842-967b-4683-8444-1b32bcc25d06 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.542438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33652842-967b-4683-8444-1b32bcc25d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.562540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-33652842-967b-4683-8444-1b32bcc25d06 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:45.563753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-33652842-967b-4683-8444-1b32bcc25d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:45.572007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 154/295] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:45.596888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817e50f-65b8-48d7-9203-2405e777a44e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.611155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817e50f-65b8-48d7-9203-2405e777a44e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.615800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.616614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.616904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.617270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.629894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:45.637091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:45.639004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 142/296] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:45.641817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c14ac-2bd4-495e-8153-d5b9eab30383 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.642108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c14ac-2bd4-495e-8153-d5b9eab30383 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.642387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c14ac-2bd4-495e-8153-d5b9eab30383 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.644372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.645240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 155/297] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:45.650392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf717bc-f6f5-4111-beef-1e1c887ba454 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.650684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf717bc-f6f5-4111-beef-1e1c887ba454 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.650966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf717bc-f6f5-4111-beef-1e1c887ba454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.656689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f1f8c-a978-4d89-baca-a171195a625d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.661620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.662637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.663073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.663514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.664422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:45.664882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:45.666650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:45.671309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ebf717bc-f6f5-4111-beef-1e1c887ba454 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:45.672634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ebf717bc-f6f5-4111-beef-1e1c887ba454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:45.677907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 143/298] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:45.685177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 156/299] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:45.690606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.701993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643232-0cb8-4a4e-9fb7-a02ed26e0431 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.706349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf717bc-f6f5-4111-beef-1e1c887ba454 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.711321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.712506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.713062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.713575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] PATH_INFO: `/v3/users/ca36217d30a7491997bb9ba0042f829d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.717065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf717bc-f6f5-4111-beef-1e1c887ba454 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.722666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.723469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.723754 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.724032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.725755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:45.727925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:45.737192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 157/300] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:45.737424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca36217d30a7491997bb9ba0042f829d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:45.737424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:45.739433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 144/301] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:45 2022] GET /identity/v3/users/ca36217d30a7491997bb9ba0042f829d => generated 293 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:45.742768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.744862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.756413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c267a43-00e3-43dc-a8a6-39af876c0318 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.760920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac5a8c-780c-4155-a345-8a3637badb39 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.761312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b34d26-6da9-4a51-9ce6-17fad214234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.762017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34d26-6da9-4a51-9ce6-17fad214234d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.763198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34d26-6da9-4a51-9ce6-17fad214234d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.763594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b34d26-6da9-4a51-9ce6-17fad214234d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.764717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34d26-6da9-4a51-9ce6-17fad214234d admin admin] RBAC: Adding query filter params (role.id=a439ca6f3a8e4e689c96c5715981685a, user.id=ca36217d30a7491997bb9ba0042f829d, scope.system=all) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:45.765035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34d26-6da9-4a51-9ce6-17fad214234d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:45.767046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b34d26-6da9-4a51-9ce6-17fad214234d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:45.771131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.772586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.773457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.774227 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] PATH_INFO: `/v3/groups` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.775704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:45.775863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 145/302] 10.222.0.87 () {56 vars in 1329 bytes} [Wed Feb 16 18:00:45 2022] GET /identity/v3/role_assignments?user.id=ca36217d30a7491997bb9ba0042f829d&scope.system=all&role.id=a439ca6f3a8e4e689c96c5715981685a => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:45.778340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:45.778340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:45.778340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:45.781235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:45.852092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b7cb-372f-450c-a421-72172cffe206 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.852092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b7cb-372f-450c-a421-72172cffe206 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.852659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5b7cb-372f-450c-a421-72172cffe206 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.854784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 146/303] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:45.861224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9651-2bdf-4439-9631-a6ad623a0d35 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.861520 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9651-2bdf-4439-9631-a6ad623a0d35 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.861801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b9651-2bdf-4439-9631-a6ad623a0d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.882500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-046b9651-2bdf-4439-9631-a6ad623a0d35 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:45.883741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-046b9651-2bdf-4439-9631-a6ad623a0d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:45.892756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 147/304] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:45.905257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 158/305] 10.222.0.87 () {60 vars in 1155 bytes} [Wed Feb 16 18:00:45 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:45.916900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b9651-2bdf-4439-9631-a6ad623a0d35 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.928372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b9651-2bdf-4439-9631-a6ad623a0d35 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.933591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.935348 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.935803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.936298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.952415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:45.960930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:45.962673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 148/306] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:45.970436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:45.981456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193134e-77ec-4a75-be6a-c4bdb6abac36 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:45.986714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:45.987412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:45.987700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:45.987979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:45.988757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:45.989073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:45.990824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.006228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 159/307] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:46.013875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.026628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e5ad7-1a14-4c10-a0be-6c2445116f64 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.032721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2653-f72b-485d-bbd0-c86f7092db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.033667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2653-f72b-485d-bbd0-c86f7092db12 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.033960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2653-f72b-485d-bbd0-c86f7092db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.034242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2653-f72b-485d-bbd0-c86f7092db12 admin admin] PATH_INFO: `/v3/users/9c7dae9069074be49804342c84163c98` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.035536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2653-f72b-485d-bbd0-c86f7092db12 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c7dae9069074be49804342c84163c98)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:46.037770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2653-f72b-485d-bbd0-c86f7092db12 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.039846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 149/308] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:46 2022] GET /identity/v3/users/9c7dae9069074be49804342c84163c98 => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:46.048796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.067307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a3b10-bca6-4c91-9beb-1a40d9ed8b07 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.081016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b7722-03a2-41dc-8c9a-cbd7c31c3e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.083110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b7722-03a2-41dc-8c9a-cbd7c31c3e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.083940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b7722-03a2-41dc-8c9a-cbd7c31c3e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.084728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b7722-03a2-41dc-8c9a-cbd7c31c3e67 admin admin] PATH_INFO: `/v3/system/users/9c7dae9069074be49804342c84163c98/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.094900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b7722-03a2-41dc-8c9a-cbd7c31c3e67 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9c7dae9069074be49804342c84163c98, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:46.097393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-8f4b7722-03a2-41dc-8c9a-cbd7c31c3e67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:46.097393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:46.097393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:46.099725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b7722-03a2-41dc-8c9a-cbd7c31c3e67 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.194511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 160/309] 10.222.0.87 () {58 vars in 1355 bytes} [Wed Feb 16 18:00:46 2022] PUT /identity/v3/system/users/9c7dae9069074be49804342c84163c98/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:46.341690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046e5a-4f70-4196-966e-ce7b47dbe2f3 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.342183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046e5a-4f70-4196-966e-ce7b47dbe2f3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.342370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046e5a-4f70-4196-966e-ce7b47dbe2f3 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.344288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 150/310] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:46.350785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b89c-bb99-4730-bd90-94227ccfb725 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.351206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b89c-bb99-4730-bd90-94227ccfb725 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.352365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b89c-bb99-4730-bd90-94227ccfb725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.380404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2331b89c-bb99-4730-bd90-94227ccfb725 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:46.380404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2331b89c-bb99-4730-bd90-94227ccfb725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:46.390128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 161/311] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:46.416141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10046e5a-4f70-4196-966e-ce7b47dbe2f3 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.431823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10046e5a-4f70-4196-966e-ce7b47dbe2f3 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.437383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.438284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.438634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.438977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.462120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:46.465567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:46.467121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 151/312] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:46.474200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b89c-bb99-4730-bd90-94227ccfb725 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.484623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b89c-bb99-4730-bd90-94227ccfb725 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.489675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.493472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.493472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.493472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.493472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:46.493472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:46.494399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.504697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 162/313] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:46.525440 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.544481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b5396-fbb8-4769-81ee-003ee8454f6c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.553550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.554513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.554799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.555075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] PATH_INFO: `/v3/users/fd7a77a2b41a467f896307a7766b51d2` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.557529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=fd7a77a2b41a467f896307a7766b51d2)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:46.559980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.566262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 152/314] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:46 2022] GET /identity/v3/users/fd7a77a2b41a467f896307a7766b51d2 => generated 297 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:46.568970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.580937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b815-1884-4432-83f5-9e559a237dc6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.586014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.586774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.587061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.587391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.597208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:46.599119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.610610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 163/315] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:46.618478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.644270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796d43-4c3d-4bb4-b889-e0f060dacdf4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.652620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f3919-ef92-412c-af67-a410a685ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.653607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f3919-ef92-412c-af67-a410a685ad7d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.653896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f3919-ef92-412c-af67-a410a685ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.654175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f3919-ef92-412c-af67-a410a685ad7d admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.661116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f3919-ef92-412c-af67-a410a685ad7d admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:46.661116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f3919-ef92-412c-af67-a410a685ad7d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.667875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 153/316] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:46 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:46.672263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:46.686640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc22c-2b35-4d7d-9161-355eee49bfbb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:46.695138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616181a-4708-4d4c-ba36-c5e3b76f8bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:46.696226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616181a-4708-4d4c-ba36-c5e3b76f8bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:46.696719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616181a-4708-4d4c-ba36-c5e3b76f8bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:46.697368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616181a-4708-4d4c-ba36-c5e3b76f8bd3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:46.698508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616181a-4708-4d4c-ba36-c5e3b76f8bd3 admin admin] RBAC: Adding query filter params (role.id=a439ca6f3a8e4e689c96c5715981685a, scope.project.id=aea7aefae5004978a40b0657cb85a6c5, user.id=fd7a77a2b41a467f896307a7766b51d2) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:46.699099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616181a-4708-4d4c-ba36-c5e3b76f8bd3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:46.701543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616181a-4708-4d4c-ba36-c5e3b76f8bd3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:46.709338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 164/317] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:00:46 2022] GET /identity/v3/role_assignments?user.id=fd7a77a2b41a467f896307a7766b51d2&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=a439ca6f3a8e4e689c96c5715981685a => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:48.405992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddf05e-5ca7-4cb1-8be7-53c85d63b4d2 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.406516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddf05e-5ca7-4cb1-8be7-53c85d63b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.406588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddf05e-5ca7-4cb1-8be7-53c85d63b4d2 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.408586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 154/318] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:48.414080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50c06-766a-485e-aa16-f54b7ddadb6d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.414555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50c06-766a-485e-aa16-f54b7ddadb6d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.414623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50c06-766a-485e-aa16-f54b7ddadb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.436813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-4fb50c06-766a-485e-aa16-f54b7ddadb6d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:48.438095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4fb50c06-766a-485e-aa16-f54b7ddadb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:48.445936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 165/319] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:48.471611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddf05e-5ca7-4cb1-8be7-53c85d63b4d2 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.486017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddf05e-5ca7-4cb1-8be7-53c85d63b4d2 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.490656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.491502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.491786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.492060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.504744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:48.512051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:48.514338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 155/320] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:48.519967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb50c06-766a-485e-aa16-f54b7ddadb6d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.530793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb50c06-766a-485e-aa16-f54b7ddadb6d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.535317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.536002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.536290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.536571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.537390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:48.537705 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:48.539358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:48.550558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 166/321] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:48.556093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.566915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff13ad6-425c-425c-9bc7-816f52f76d1f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.571382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d02510-0d20-486e-a930-5802029b562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.572261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d02510-0d20-486e-a930-5802029b562d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.572540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d02510-0d20-486e-a930-5802029b562d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.572808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d02510-0d20-486e-a930-5802029b562d admin admin] PATH_INFO: `/v3/users/ca36217d30a7491997bb9ba0042f829d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.574062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d02510-0d20-486e-a930-5802029b562d admin admin] RBAC: Authorizing `identity:get_user(user_id=ca36217d30a7491997bb9ba0042f829d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:48.576634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d02510-0d20-486e-a930-5802029b562d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:48.578501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 156/322] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:48 2022] GET /identity/v3/users/ca36217d30a7491997bb9ba0042f829d => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:48.584282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.595601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc020615-d04c-4862-9520-c82c26c49f9e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.600092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74ba2-d598-416b-a612-e6ada17faa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.600975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74ba2-d598-416b-a612-e6ada17faa82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.601295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74ba2-d598-416b-a612-e6ada17faa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.601581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74ba2-d598-416b-a612-e6ada17faa82 admin admin] PATH_INFO: `/v3/system/users/ca36217d30a7491997bb9ba0042f829d/roles/a439ca6f3a8e4e689c96c5715981685a` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.603120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da74ba2-d598-416b-a612-e6ada17faa82 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ca36217d30a7491997bb9ba0042f829d, role_id=a439ca6f3a8e4e689c96c5715981685a)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:48.604760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da74ba2-d598-416b-a612-e6ada17faa82 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:48.693329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 167/323] 10.222.0.87 () {58 vars in 1355 bytes} [Wed Feb 16 18:00:48 2022] PUT /identity/v3/system/users/ca36217d30a7491997bb9ba0042f829d/roles/a439ca6f3a8e4e689c96c5715981685a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:48.738504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ef343-e170-47d0-9c14-226638afaab5 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.738854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ef343-e170-47d0-9c14-226638afaab5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.739048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ef343-e170-47d0-9c14-226638afaab5 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.741218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 157/324] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:48.747380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901900a-dea9-4149-a7d2-cbeb5224d1ff None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.747690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901900a-dea9-4149-a7d2-cbeb5224d1ff None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.748031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901900a-dea9-4149-a7d2-cbeb5224d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.769001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e901900a-dea9-4149-a7d2-cbeb5224d1ff None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:48.770288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e901900a-dea9-4149-a7d2-cbeb5224d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:48.779446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 168/325] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:48.805007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ef343-e170-47d0-9c14-226638afaab5 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.818295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ef343-e170-47d0-9c14-226638afaab5 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.823254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6311fc3-9bc9-4626-88bd-d8bf81c94021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.824095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311fc3-9bc9-4626-88bd-d8bf81c94021 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.825133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311fc3-9bc9-4626-88bd-d8bf81c94021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.825282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311fc3-9bc9-4626-88bd-d8bf81c94021 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.826998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6311fc3-9bc9-4626-88bd-d8bf81c94021 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:48.829190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6311fc3-9bc9-4626-88bd-d8bf81c94021 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:48.831240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 158/326] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:00:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:48.837271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901900a-dea9-4149-a7d2-cbeb5224d1ff None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.846880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be60a-f2ca-4b95-abe4-8e20ff74d56b None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.847171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be60a-f2ca-4b95-abe4-8e20ff74d56b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.847453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64be60a-f2ca-4b95-abe4-8e20ff74d56b None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.849352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 159/327] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:48.852076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901900a-dea9-4149-a7d2-cbeb5224d1ff None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.855914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeace7-45f1-490d-bdb6-d933aaecccfe None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.856784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeace7-45f1-490d-bdb6-d933aaecccfe None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.857292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeace7-45f1-490d-bdb6-d933aaecccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.858201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a30c8c-280e-467b-9f7b-0ffe602c7a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.858946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a30c8c-280e-467b-9f7b-0ffe602c7a1a admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.859241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a30c8c-280e-467b-9f7b-0ffe602c7a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.859521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a30c8c-280e-467b-9f7b-0ffe602c7a1a admin admin] PATH_INFO: `/v3/groups` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.860250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a30c8c-280e-467b-9f7b-0ffe602c7a1a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:48.862400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a30c8c-280e-467b-9f7b-0ffe602c7a1a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:48.878402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-feaeace7-45f1-490d-bdb6-d933aaecccfe None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:48.879665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-feaeace7-45f1-490d-bdb6-d933aaecccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:48.888583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 160/328] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:48.914619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeace7-45f1-490d-bdb6-d933aaecccfe None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.924426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeace7-45f1-490d-bdb6-d933aaecccfe None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.929366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.930183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.930538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.930826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.943052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:48.951105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:48.952356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 161/329] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:48.958164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:48.969499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a471f6-27ef-45de-ab9a-8015e4f2afbd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:48.974298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:48.975029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:48.975342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:48.975620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:48.976371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:48.976679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:48.978316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:48.988334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 162/330] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:48.996487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:49.003425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a600d7-d21a-4fab-98ed-39e0efd18c8b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:49.007780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:49.008676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:49.008960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:49.009276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] PATH_INFO: `/v3/users/9c7dae9069074be49804342c84163c98` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:49.010461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c7dae9069074be49804342c84163c98)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:49.013375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:49.015188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 163/331] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:48 2022] GET /identity/v3/users/9c7dae9069074be49804342c84163c98 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:49.020644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:49.031186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfde0b7-cc60-4444-909f-5485030dedf6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:49.032897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 169/332] 10.222.0.87 () {60 vars in 1155 bytes} [Wed Feb 16 18:00:48 2022] POST /identity/v3/groups => generated 226 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:00:49.036172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec2aad-b3f5-4b61-b24b-3fcd8c8f4f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:49.037348 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2aad-b3f5-4b61-b24b-3fcd8c8f4f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:49.037731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2aad-b3f5-4b61-b24b-3fcd8c8f4f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:49.038047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec2aad-b3f5-4b61-b24b-3fcd8c8f4f6a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:49.039031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec2aad-b3f5-4b61-b24b-3fcd8c8f4f6a admin admin] RBAC: Adding query filter params (role.id=49988fd7322b428281a0ca4fe1b6fd51, user.id=9c7dae9069074be49804342c84163c98, scope.system=all) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:49.039417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec2aad-b3f5-4b61-b24b-3fcd8c8f4f6a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:49.041486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec2aad-b3f5-4b61-b24b-3fcd8c8f4f6a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:49.065221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 164/333] 10.222.0.87 () {56 vars in 1329 bytes} [Wed Feb 16 18:00:49 2022] GET /identity/v3/role_assignments?user.id=9c7dae9069074be49804342c84163c98&scope.system=all&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 510 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:51.523235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed613f-0dc8-432e-9d85-cd8d97c5affb None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:51.523733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed613f-0dc8-432e-9d85-cd8d97c5affb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:51.523733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed613f-0dc8-432e-9d85-cd8d97c5affb None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:51.525985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 170/334] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:51.543077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33238186-b58e-4e27-8e48-8033b1450ef6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:51.543571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33238186-b58e-4e27-8e48-8033b1450ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:51.544454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33238186-b58e-4e27-8e48-8033b1450ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:51.569234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-33238186-b58e-4e27-8e48-8033b1450ef6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:51.570442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-33238186-b58e-4e27-8e48-8033b1450ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:51.585241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 165/335] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:51.627625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed613f-0dc8-432e-9d85-cd8d97c5affb None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:51.643540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed613f-0dc8-432e-9d85-cd8d97c5affb None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:51.649926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:51.650732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:51.651025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:51.651305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:51.677799 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:51.685812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 18:00:51.687250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 171/336] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:51.693153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33238186-b58e-4e27-8e48-8033b1450ef6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:51.706630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33238186-b58e-4e27-8e48-8033b1450ef6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:51.714296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:51.715561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:51.716727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:51.716918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:51.717684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:51.717994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:51.719596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:51.736820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 166/337] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:51.742086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:51.761416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e02418-b38d-4435-9cc5-4fc45eb9487d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:51.773363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb7fe8-5eb5-4e31-9000-3fb7ba1d6c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:51.774191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb7fe8-5eb5-4e31-9000-3fb7ba1d6c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:51.774478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb7fe8-5eb5-4e31-9000-3fb7ba1d6c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:51.774755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb7fe8-5eb5-4e31-9000-3fb7ba1d6c62 admin admin] PATH_INFO: `/v3/users/ca36217d30a7491997bb9ba0042f829d` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:51.779725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb7fe8-5eb5-4e31-9000-3fb7ba1d6c62 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca36217d30a7491997bb9ba0042f829d)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:51.782114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb7fe8-5eb5-4e31-9000-3fb7ba1d6c62 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:51.783822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 172/338] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:00:51 2022] GET /identity/v3/users/ca36217d30a7491997bb9ba0042f829d => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:51.789601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:51.806890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921885a0-1095-4fdf-980d-d604df46cb6d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:51.817513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2282505-18b9-4968-b305-9c4405559af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:51.818197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282505-18b9-4968-b305-9c4405559af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:51.818484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282505-18b9-4968-b305-9c4405559af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:51.818764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2282505-18b9-4968-b305-9c4405559af1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:51.819614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2282505-18b9-4968-b305-9c4405559af1 admin admin] RBAC: Adding query filter params (role.id=a439ca6f3a8e4e689c96c5715981685a, user.id=ca36217d30a7491997bb9ba0042f829d, scope.system=all) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:51.819933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2282505-18b9-4968-b305-9c4405559af1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:51.822097 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2282505-18b9-4968-b305-9c4405559af1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:51.853886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 167/339] 10.222.0.87 () {56 vars in 1329 bytes} [Wed Feb 16 18:00:51 2022] GET /identity/v3/role_assignments?user.id=ca36217d30a7491997bb9ba0042f829d&scope.system=all&role.id=a439ca6f3a8e4e689c96c5715981685a => generated 510 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:52.157827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367e704-66d0-49e4-84e6-1f90dfef3d83 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.158230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367e704-66d0-49e4-84e6-1f90dfef3d83 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.158403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367e704-66d0-49e4-84e6-1f90dfef3d83 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.160170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 173/340] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:52.179260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d292d8-5ab6-4c97-878e-283950b765cc None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.179559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d292d8-5ab6-4c97-878e-283950b765cc None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.179833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d292d8-5ab6-4c97-878e-283950b765cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.223884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-40d292d8-5ab6-4c97-878e-283950b765cc None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:52.225163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-40d292d8-5ab6-4c97-878e-283950b765cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:52.236686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 168/341] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:52.274350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367e704-66d0-49e4-84e6-1f90dfef3d83 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.290941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367e704-66d0-49e4-84e6-1f90dfef3d83 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.296666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.297767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.298311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.298612 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.317326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:52.325280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:52.327055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 174/342] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:52.332634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d292d8-5ab6-4c97-878e-283950b765cc None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.347753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d292d8-5ab6-4c97-878e-283950b765cc None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.352539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.353254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.353535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.353821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.354564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:52.354887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.357558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.378531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 169/343] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:52.383980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.398832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f8ef-fe1d-4df7-93e2-a0b5aa400934 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.408493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.409104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.409399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.409681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.422670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.424458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.442504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 175/344] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:52.449051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.470996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240eb97-2877-4cbf-9036-b6e71e9bb975 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.483684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.485066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.485533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.485962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.487881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.491369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.495436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 170/345] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:52.502247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.519566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40747023-9dcf-4d74-8f3a-5caa53acb41f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.530372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40d4cd-b9d3-4cf1-9b97-c37f848a4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.531745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d4cd-b9d3-4cf1-9b97-c37f848a4d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.532186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d4cd-b9d3-4cf1-9b97-c37f848a4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.532615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40d4cd-b9d3-4cf1-9b97-c37f848a4d24 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.551676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40d4cd-b9d3-4cf1-9b97-c37f848a4d24 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.553501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-dd40d4cd-b9d3-4cf1-9b97-c37f848a4d24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:52.553501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:00:52.553501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:00:52.555682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40d4cd-b9d3-4cf1-9b97-c37f848a4d24 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.558490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 176/346] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:52.564108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.577829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868cc43-bf0f-4e11-8d67-4710a0a91a54 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.584752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.585415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.585699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.585978 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.586810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=32d4a5ac6711498799101bfed49ee0ba) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:52.587122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.588052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8298-7031-4986-a163-d2d492ca7656 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.588340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8298-7031-4986-a163-d2d492ca7656 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.588609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee8298-7031-4986-a163-d2d492ca7656 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.588959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.591143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 177/347] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:52.600136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 171/348] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:52.600522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18e56-d574-4d50-863b-08c5de98539c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.600812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18e56-d574-4d50-863b-08c5de98539c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.601102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18e56-d574-4d50-863b-08c5de98539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.638938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-aeb18e56-d574-4d50-863b-08c5de98539c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:52.640205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-aeb18e56-d574-4d50-863b-08c5de98539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:52.659641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 178/349] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:52.722626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.738624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161c5bb-8606-4259-9e83-889b74694221 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.745289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.746126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.746641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.746933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.772843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:52.784751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:52.791810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 172/350] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:52.798202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18e56-d574-4d50-863b-08c5de98539c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.819567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18e56-d574-4d50-863b-08c5de98539c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.827563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.828615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.829099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.829577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.830569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:52.831053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.832865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.848294 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 179/351] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:52.854071 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.872774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f723d8f-a51d-4dcb-8024-1a624aca4032 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.881647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.882322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.882607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.882875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.900979 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.902819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.915289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 173/352] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:52.921486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.936221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220e658-a0a7-4aa2-932e-37ef388dceb0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.944384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.945300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.945588 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.945867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:52.951351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:52.953557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:52.955704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 180/353] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:52.961922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:52.984927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f263-ea95-455e-91ed-b8c271c7d806 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:52.994572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2730f66-3e38-40de-870d-e8ccdb22e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:52.996029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2730f66-3e38-40de-870d-e8ccdb22e748 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:52.996563 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2730f66-3e38-40de-870d-e8ccdb22e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:52.997054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2730f66-3e38-40de-870d-e8ccdb22e748 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.000617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2730f66-3e38-40de-870d-e8ccdb22e748 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.002456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-c2730f66-3e38-40de-870d-e8ccdb22e748 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:00:53.002456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:00:53.002456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:00:53.004659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2730f66-3e38-40de-870d-e8ccdb22e748 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.008101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 174/354] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:52 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.014110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.026354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4434d2-354d-4349-ba56-4f5f4afe30c3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.035140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cbff9-0da6-4c57-814a-e551a31fb7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.035812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbff9-0da6-4c57-814a-e551a31fb7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.036102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbff9-0da6-4c57-814a-e551a31fb7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.036388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbff9-0da6-4c57-814a-e551a31fb7a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.037278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cbff9-0da6-4c57-814a-e551a31fb7a2 admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=dc6090b70eff456892de81377068fadd, scope.project.id=32d4a5ac6711498799101bfed49ee0ba) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:53.037598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cbff9-0da6-4c57-814a-e551a31fb7a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.039473 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cbff9-0da6-4c57-814a-e551a31fb7a2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.049902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 181/355] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=dc6090b70eff456892de81377068fadd => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.101698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071d941-29b4-44f1-828b-12ac0fcfcbe7 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.102014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071d941-29b4-44f1-828b-12ac0fcfcbe7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.102209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071d941-29b4-44f1-828b-12ac0fcfcbe7 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.104414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 175/356] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:53.110222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ce1df-7d5d-46ee-a9cd-d30cfce9bf56 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.110565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ce1df-7d5d-46ee-a9cd-d30cfce9bf56 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.110780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ce1df-7d5d-46ee-a9cd-d30cfce9bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.135684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7f0ce1df-7d5d-46ee-a9cd-d30cfce9bf56 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:53.137723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7f0ce1df-7d5d-46ee-a9cd-d30cfce9bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:53.148359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 182/357] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:53.194462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071d941-29b4-44f1-828b-12ac0fcfcbe7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.211389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071d941-29b4-44f1-828b-12ac0fcfcbe7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.221917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.222759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.223042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.223318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.241541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:53.249193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:53.250426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 176/358] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:53.256438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ce1df-7d5d-46ee-a9cd-d30cfce9bf56 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.273121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ce1df-7d5d-46ee-a9cd-d30cfce9bf56 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.284017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.284721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.285010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.285319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.286110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:53.286420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.288086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.303704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 183/359] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.309483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.323581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d826729-f131-45ad-9f3b-5e94b3ed9c5f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.332696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.333388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.333672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.333952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.346187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.347920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.361381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 177/360] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:53.366861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.380410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628e33e-c749-4707-8980-fc956fc7832c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.386090 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.387500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.387832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.388218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.389791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.391856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.394928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 184/361] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.400786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.414332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f738-0746-476e-ada6-505c5777f31a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.425381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992fa08-3532-4695-84c3-661aaea640d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.426400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992fa08-3532-4695-84c3-661aaea640d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.426893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992fa08-3532-4695-84c3-661aaea640d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.427170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992fa08-3532-4695-84c3-661aaea640d6 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.428390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992fa08-3532-4695-84c3-661aaea640d6 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.430318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992fa08-3532-4695-84c3-661aaea640d6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.431961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 178/362] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.441128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.451857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060539-44a4-4d70-b8fb-6764abc740ac admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.466059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6244e1-721e-4b80-932a-c75919a8b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.467111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6244e1-721e-4b80-932a-c75919a8b793 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.467362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6244e1-721e-4b80-932a-c75919a8b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.467641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6244e1-721e-4b80-932a-c75919a8b793 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.468477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6244e1-721e-4b80-932a-c75919a8b793 admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=aea7aefae5004978a40b0657cb85a6c5) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:53.468786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6244e1-721e-4b80-932a-c75919a8b793 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.470834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6244e1-721e-4b80-932a-c75919a8b793 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.477238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 185/363] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.606265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaed7a-298b-414c-9044-c5f8610a33f0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.606927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaed7a-298b-414c-9044-c5f8610a33f0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.606927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaed7a-298b-414c-9044-c5f8610a33f0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.608715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 179/364] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:53.614644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656769c0-c60e-41b2-a967-974d36611fbc None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.615249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656769c0-c60e-41b2-a967-974d36611fbc None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.615249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656769c0-c60e-41b2-a967-974d36611fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.643197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-656769c0-c60e-41b2-a967-974d36611fbc None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:53.644387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-656769c0-c60e-41b2-a967-974d36611fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:53.652130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 186/365] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:53.695571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaed7a-298b-414c-9044-c5f8610a33f0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.713988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaed7a-298b-414c-9044-c5f8610a33f0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.719174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.719986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.720268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.720537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.734441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:53.742024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:53.743620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 180/366] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:53.750514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656769c0-c60e-41b2-a967-974d36611fbc None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.760314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656769c0-c60e-41b2-a967-974d36611fbc None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.769664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.770353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.770638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.770912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.771683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:53.771985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.773806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.784456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 187/367] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.790454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.801881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b575a14-7d7d-4159-8c97-b0ad7b8df951 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.806780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.807442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.807726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.808171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.818181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.819952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.830032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 181/368] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:00:53.835803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.846894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9ed83-9021-4f3e-9bed-e607c16cc091 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.851550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.852425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.852704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.852978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.854224 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.857206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.859197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 188/369] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.864851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.874576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d10b6-e81e-4f1e-9879-e6d699a0e83c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.879109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baa00e-bd9a-4335-bc09-5a9a4719624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.879969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa00e-bd9a-4335-bc09-5a9a4719624c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.880244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa00e-bd9a-4335-bc09-5a9a4719624c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.880535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa00e-bd9a-4335-bc09-5a9a4719624c admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.881721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baa00e-bd9a-4335-bc09-5a9a4719624c admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.883615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baa00e-bd9a-4335-bc09-5a9a4719624c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.885251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 182/370] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:53.891258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:53.901231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ebc5-9b9d-4f34-b5f7-9c7a35b3089b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:53.907029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f69db5-5015-41ec-94d8-57d2be7f192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:53.907692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69db5-5015-41ec-94d8-57d2be7f192d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:53.907972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69db5-5015-41ec-94d8-57d2be7f192d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:53.908250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69db5-5015-41ec-94d8-57d2be7f192d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:53.909098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f69db5-5015-41ec-94d8-57d2be7f192d admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=dc6090b70eff456892de81377068fadd, scope.project.id=aea7aefae5004978a40b0657cb85a6c5) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:53.909416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f69db5-5015-41ec-94d8-57d2be7f192d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:53.911259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f69db5-5015-41ec-94d8-57d2be7f192d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:53.917624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 189/371] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:00:53 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=dc6090b70eff456892de81377068fadd => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:54.612957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b825d-30bc-40d9-9533-ea6c63c10e3c None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:54.613651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b825d-30bc-40d9-9533-ea6c63c10e3c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:54.613651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b825d-30bc-40d9-9533-ea6c63c10e3c None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:54.616003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 183/372] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:54.622832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc12b4-24d7-4afe-8033-a21ec6049501 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:54.623439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc12b4-24d7-4afe-8033-a21ec6049501 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:54.623594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc12b4-24d7-4afe-8033-a21ec6049501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:54.665447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a3fc12b4-24d7-4afe-8033-a21ec6049501 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:54.666877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a3fc12b4-24d7-4afe-8033-a21ec6049501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:54.681205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 190/373] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:54.731373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b825d-30bc-40d9-9533-ea6c63c10e3c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:54.754106 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b825d-30bc-40d9-9533-ea6c63c10e3c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:54.759410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:54.760222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:54.760499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:54.760769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:54.783232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:54.786155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:54.787967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 184/374] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:54.796496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc12b4-24d7-4afe-8033-a21ec6049501 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:54.815828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc12b4-24d7-4afe-8033-a21ec6049501 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:54.830750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:54.831448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:54.831751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:54.832021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:54.832780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:54.833103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:54.834708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:54.844767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 191/375] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:54.850541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:54.869850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e924c95-5f62-4d5f-b5a2-f698f2488338 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:54.878274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:54.879324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:54.879864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:54.880468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:54.891520 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:54.893659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:54.906957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 185/376] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:00:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:00:54.912827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:54.927505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cb12-fee1-45ae-87d3-827e2808d622 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:54.935473 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:54.936738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:54.937179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:54.937488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] PATH_INFO: `/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:54.938753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] RBAC: Authorizing `identity:get_project(project_id=cbda6004e23b4962aaf44dfcd57b21b1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:54.940729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:54.942554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 192/377] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:54 2022] GET /identity/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1 => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:54.948242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:54.961674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acade749-a695-4403-b515-e2b29c09629a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:54.968558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e93b-032f-456a-80f4-8ccfabdc397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:54.969829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e93b-032f-456a-80f4-8ccfabdc397b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:54.970368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e93b-032f-456a-80f4-8ccfabdc397b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:54.970843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e93b-032f-456a-80f4-8ccfabdc397b admin admin] PATH_INFO: `/v3/groups/917f3014ca62435daf46e734b874d32d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:54.979198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e93b-032f-456a-80f4-8ccfabdc397b admin admin] RBAC: Authorizing `identity:get_group(group_id=917f3014ca62435daf46e734b874d32d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:54.982200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e93b-032f-456a-80f4-8ccfabdc397b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:54.984566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 186/378] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:54 2022] GET /identity/v3/groups/917f3014ca62435daf46e734b874d32d => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:54.990288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:55.007699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1c7e-943f-478e-b685-23a04b670fef admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:55.015270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2a9b2-9afc-4b14-bf70-de778fe8a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:55.016355 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a9b2-9afc-4b14-bf70-de778fe8a036 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.016986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a9b2-9afc-4b14-bf70-de778fe8a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.017719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a9b2-9afc-4b14-bf70-de778fe8a036 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.018914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2a9b2-9afc-4b14-bf70-de778fe8a036 admin admin] RBAC: Adding query filter params (group.id=917f3014ca62435daf46e734b874d32d, role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=cbda6004e23b4962aaf44dfcd57b21b1) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:55.019456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2a9b2-9afc-4b14-bf70-de778fe8a036 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:55.021818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2a9b2-9afc-4b14-bf70-de778fe8a036 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:55.029252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 193/379] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:00:54 2022] GET /identity/v3/role_assignments?group.id=917f3014ca62435daf46e734b874d32d&scope.project.id=cbda6004e23b4962aaf44dfcd57b21b1&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:55.706840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d182-ac75-4605-b9e3-971e47a752b0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.707881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d182-ac75-4605-b9e3-971e47a752b0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.708390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d182-ac75-4605-b9e3-971e47a752b0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.710741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 187/380] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:55.717339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955b99-61d4-4d3d-9462-27a01c71e825 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.718252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955b99-61d4-4d3d-9462-27a01c71e825 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.718752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955b99-61d4-4d3d-9462-27a01c71e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.742175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ed955b99-61d4-4d3d-9462-27a01c71e825 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:55.743397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ed955b99-61d4-4d3d-9462-27a01c71e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:55.756870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 194/381] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:55.782224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d182-ac75-4605-b9e3-971e47a752b0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:55.808183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d182-ac75-4605-b9e3-971e47a752b0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:55.815155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:55.816361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.816901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.817430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.834933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:55.847452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:55.849116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 188/382] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:55.855185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955b99-61d4-4d3d-9462-27a01c71e825 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:55.870344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955b99-61d4-4d3d-9462-27a01c71e825 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:55.875866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:55.876543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.876827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.877118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.877877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:55.878185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:55.879781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:55.897315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 195/383] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:55.904675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:55.916367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda29fb-0c29-4d1a-b874-966377fdec77 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:55.923379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:55.924665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.925182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.925687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.927394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:55.929605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:55.937477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 189/384] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:55 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:55.937639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:55.950864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26934d-1064-47dc-82c2-3b3d237cd1a5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:55.956072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf2ef4-1175-4987-9d49-1fd0b78bf902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:55.957408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf2ef4-1175-4987-9d49-1fd0b78bf902 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.957917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf2ef4-1175-4987-9d49-1fd0b78bf902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.958440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf2ef4-1175-4987-9d49-1fd0b78bf902 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.959939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf2ef4-1175-4987-9d49-1fd0b78bf902 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:55.962445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf2ef4-1175-4987-9d49-1fd0b78bf902 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:55.964767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 196/385] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:55 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:55.971867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:55.983519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a382-ec40-41a8-801a-0c098302a2b8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:55.988726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42802919-198a-40b2-9c3a-8c317699678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:55.989942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802919-198a-40b2-9c3a-8c317699678b admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:55.990497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802919-198a-40b2-9c3a-8c317699678b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:55.990975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42802919-198a-40b2-9c3a-8c317699678b admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba/groups/2610ff6184c641f8a20b4f15fc36f144/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:55.993342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42802919-198a-40b2-9c3a-8c317699678b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d4a5ac6711498799101bfed49ee0ba, group_id=2610ff6184c641f8a20b4f15fc36f144, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:55.996564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42802919-198a-40b2-9c3a-8c317699678b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:56.135784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 190/386] 10.222.0.87 () {58 vars in 1463 bytes} [Wed Feb 16 18:00:55 2022] PUT /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba/groups/2610ff6184c641f8a20b4f15fc36f144/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:56.589268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb02a-d730-4908-9bde-96bed0401051 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.589661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb02a-d730-4908-9bde-96bed0401051 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.590561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb02a-d730-4908-9bde-96bed0401051 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.594663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 197/387] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:56.599873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b834a63-06bd-44c2-a0fa-cf006a7d75eb None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.600160 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b834a63-06bd-44c2-a0fa-cf006a7d75eb None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.600442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b834a63-06bd-44c2-a0fa-cf006a7d75eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.623798 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2b834a63-06bd-44c2-a0fa-cf006a7d75eb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:56.625010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2b834a63-06bd-44c2-a0fa-cf006a7d75eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:56.701313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 191/388] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:56.737171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddb02a-d730-4908-9bde-96bed0401051 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:56.755212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddb02a-d730-4908-9bde-96bed0401051 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:56.759542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:56.760339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.760623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.760901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.780000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:56.787258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:00:56.788502 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 198/389] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:56.795528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b834a63-06bd-44c2-a0fa-cf006a7d75eb None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:56.805060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b834a63-06bd-44c2-a0fa-cf006a7d75eb None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:56.812742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:56.813457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.813741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.814017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.814772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:56.815080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:56.816685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:56.826122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 192/390] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:00:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:56.831729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:56.845798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1605c-b5c3-4b5b-82f2-582f4dd1cc6b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:56.850264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:56.851159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.851438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.851713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.853002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:56.854987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:56.860448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 199/391] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:56 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:56.866017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:56.877766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ed0b0-78fa-492a-816b-ea674301505a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:56.884951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff27e45-6a1a-4127-a1be-aaebb6102f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:56.885891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27e45-6a1a-4127-a1be-aaebb6102f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.886176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27e45-6a1a-4127-a1be-aaebb6102f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.886457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27e45-6a1a-4127-a1be-aaebb6102f09 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.888316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27e45-6a1a-4127-a1be-aaebb6102f09 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:56.890505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27e45-6a1a-4127-a1be-aaebb6102f09 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:56.892338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 193/392] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:56 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:56.898236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:56.913414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfe4a8-071f-4ce2-af8e-f9357fd19101 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:56.918720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:56.919680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.920019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.920300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5/groups/2610ff6184c641f8a20b4f15fc36f144/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.922345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7aefae5004978a40b0657cb85a6c5, group_id=2610ff6184c641f8a20b4f15fc36f144, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:56.925004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:56.989796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159d993-0506-464e-819e-6d9a18bd2a00 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.990090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159d993-0506-464e-819e-6d9a18bd2a00 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.990354 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159d993-0506-464e-819e-6d9a18bd2a00 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:56.992456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 194/393] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:00:56.997507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0336-38ec-4b54-9452-c17cc36853f6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:56.997866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0336-38ec-4b54-9452-c17cc36853f6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:56.998281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca0336-38ec-4b54-9452-c17cc36853f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.020721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c2ca0336-38ec-4b54-9452-c17cc36853f6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:57.022051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c2ca0336-38ec-4b54-9452-c17cc36853f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:57.032372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 195/394] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:00:57.062539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0336-38ec-4b54-9452-c17cc36853f6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.075318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 200/395] 10.222.0.87 () {58 vars in 1463 bytes} [Wed Feb 16 18:00:56 2022] PUT /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5/groups/2610ff6184c641f8a20b4f15fc36f144/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:57.079416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca0336-38ec-4b54-9452-c17cc36853f6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.163508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.164613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.164972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.165333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.181782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:57.190197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:57.191815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 196/396] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:57.197972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.214551 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb764e5e-0b63-40f9-903e-324ff1af005e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.220150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.224578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.224979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.225436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.226319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:57.226739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.228484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.243878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 201/397] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:57.251514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.274765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2dcf6-6a66-40eb-a541-c90525c6fbc7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.294430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10b54-f015-44aa-ad32-b4c6cc020a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.296222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10b54-f015-44aa-ad32-b4c6cc020a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.296730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10b54-f015-44aa-ad32-b4c6cc020a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.297266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10b54-f015-44aa-ad32-b4c6cc020a4b admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.299473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10b54-f015-44aa-ad32-b4c6cc020a4b admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.304296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10b54-f015-44aa-ad32-b4c6cc020a4b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.307962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 197/398] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:57.314307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.329852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ed783-f3b3-4942-a6a7-cf0bd7062cae None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.330138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ed783-f3b3-4942-a6a7-cf0bd7062cae None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.330415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ed783-f3b3-4942-a6a7-cf0bd7062cae None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.331579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa1697-8114-4d0f-9fd5-f94041f19074 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.332564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 198/399] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:57.336389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.337484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.337839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.338014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23283eb-47eb-4d6f-bf9a-45bd1a2b15fa None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.338293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23283eb-47eb-4d6f-bf9a-45bd1a2b15fa None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.338429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.338555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23283eb-47eb-4d6f-bf9a-45bd1a2b15fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.339813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.345358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.348590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 202/400] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:57.355804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.366935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a32db6-10aa-4f12-9b4a-b8ecfdf65577 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.370450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b23283eb-47eb-4d6f-bf9a-45bd1a2b15fa None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:57.372420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b23283eb-47eb-4d6f-bf9a-45bd1a2b15fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:57.372589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.374678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.375154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.375532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba/groups/2610ff6184c641f8a20b4f15fc36f144/roles/dc6090b70eff456892de81377068fadd` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.378025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d4a5ac6711498799101bfed49ee0ba, group_id=2610ff6184c641f8a20b4f15fc36f144, role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.380779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.394181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 199/401] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:57.420497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23283eb-47eb-4d6f-bf9a-45bd1a2b15fa None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.431062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23283eb-47eb-4d6f-bf9a-45bd1a2b15fa None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.442109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.443349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.443637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.443945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.457767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:57.466462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:00:57.468272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 200/402] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:00:57.473828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.485628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca840-14bb-4ff3-82ea-592fe2ba5da3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.489955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 203/403] 10.222.0.87 () {58 vars in 1463 bytes} [Wed Feb 16 18:00:57 2022] PUT /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba/groups/2610ff6184c641f8a20b4f15fc36f144/roles/dc6090b70eff456892de81377068fadd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:57.559146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.559941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.560234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.560513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.561314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:57.561634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.563672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.574043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 201/404] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:57.583422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.613453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90c1e3-4824-466d-a3bf-4def5b4a0522 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.629439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.630787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.631083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.631367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.638211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.640254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.642463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 204/405] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:00:57.649422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.661857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467506-5ce1-47cc-a1c9-46d96e8b9230 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.666941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672f5b-e724-4142-ac3d-4141993650b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.667908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672f5b-e724-4142-ac3d-4141993650b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.668859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672f5b-e724-4142-ac3d-4141993650b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.669241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672f5b-e724-4142-ac3d-4141993650b8 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.673246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672f5b-e724-4142-ac3d-4141993650b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.675583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672f5b-e724-4142-ac3d-4141993650b8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.678202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 202/406] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:57 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:57.688346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:57.710417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123cdd9-5c88-4181-8b75-5ba6d02c018b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:57.726287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1be173-0a74-448b-898d-90edc45ccf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:57.727820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1be173-0a74-448b-898d-90edc45ccf4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:57.728307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1be173-0a74-448b-898d-90edc45ccf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:57.728803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1be173-0a74-448b-898d-90edc45ccf4f admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5/groups/2610ff6184c641f8a20b4f15fc36f144/roles/dc6090b70eff456892de81377068fadd` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:57.734606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1be173-0a74-448b-898d-90edc45ccf4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea7aefae5004978a40b0657cb85a6c5, group_id=2610ff6184c641f8a20b4f15fc36f144, role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:57.739882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1be173-0a74-448b-898d-90edc45ccf4f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:57.886059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 205/407] 10.222.0.87 () {58 vars in 1463 bytes} [Wed Feb 16 18:00:57 2022] PUT /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5/groups/2610ff6184c641f8a20b4f15fc36f144/roles/dc6090b70eff456892de81377068fadd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:58.464907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122634b0-0527-488b-9fcc-4c0973fabf5f None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:58.465597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122634b0-0527-488b-9fcc-4c0973fabf5f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:58.465597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122634b0-0527-488b-9fcc-4c0973fabf5f None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:58.467477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 203/408] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:58.473254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7463d-43bb-4f1e-b158-6591d08b3f85 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:58.473555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7463d-43bb-4f1e-b158-6591d08b3f85 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:58.473815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7463d-43bb-4f1e-b158-6591d08b3f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:58.498845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a4b7463d-43bb-4f1e-b158-6591d08b3f85 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:58.500101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a4b7463d-43bb-4f1e-b158-6591d08b3f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:00:58.586865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 206/409] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:00:58.630667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122634b0-0527-488b-9fcc-4c0973fabf5f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:58.655180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122634b0-0527-488b-9fcc-4c0973fabf5f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:58.662495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:58.663314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:58.663614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:58.663899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:58.687521 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:00:58.698810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:00:58.701187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 204/410] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:00:58.706611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7463d-43bb-4f1e-b158-6591d08b3f85 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:58.727399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7463d-43bb-4f1e-b158-6591d08b3f85 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:58.738853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:58.739560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:58.739849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:58.740129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:58.740901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:00:58.741277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:58.742995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:58.760997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 207/411] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:58.767701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:58.779426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9cbb4-835a-49cd-b81e-81e77c2d82f2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:58.791021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:58.791908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:58.792185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:58.792461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] PATH_INFO: `/v3/groups/917f3014ca62435daf46e734b874d32d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:58.794009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] RBAC: Authorizing `identity:get_group(group_id=917f3014ca62435daf46e734b874d32d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:58.796042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:58.797839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 205/412] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:00:58 2022] GET /identity/v3/groups/917f3014ca62435daf46e734b874d32d => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:58.803743 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:58.818291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a7eb0-89a7-4009-8f31-4ce84dc2bb31 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:58.829564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ac590-448a-40a1-8dbf-3213c9e6d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:58.830439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac590-448a-40a1-8dbf-3213c9e6d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:58.830725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac590-448a-40a1-8dbf-3213c9e6d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:58.830999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ac590-448a-40a1-8dbf-3213c9e6d2ad admin admin] PATH_INFO: `/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:58.837882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac590-448a-40a1-8dbf-3213c9e6d2ad admin admin] RBAC: Authorizing `identity:get_project(project_id=cbda6004e23b4962aaf44dfcd57b21b1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:58.839708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ac590-448a-40a1-8dbf-3213c9e6d2ad admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:58.841930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 208/413] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:00:58 2022] GET /identity/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:00:58.847707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:00:58.858680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142a33-10b0-4e81-ab46-8169615e561d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:00:58.869527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d418d-abe5-4e58-af12-9b9011f593c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:00:58.870437 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d418d-abe5-4e58-af12-9b9011f593c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:58.870727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d418d-abe5-4e58-af12-9b9011f593c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:58.871035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d418d-abe5-4e58-af12-9b9011f593c5 admin admin] PATH_INFO: `/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1/groups/917f3014ca62435daf46e734b874d32d/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:58.878750 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d418d-abe5-4e58-af12-9b9011f593c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbda6004e23b4962aaf44dfcd57b21b1, group_id=917f3014ca62435daf46e734b874d32d, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:00:58.881532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d418d-abe5-4e58-af12-9b9011f593c5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:00:58.964531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 206/414] 10.222.0.87 () {58 vars in 1463 bytes} [Wed Feb 16 18:00:58 2022] PUT /identity/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1/groups/917f3014ca62435daf46e734b874d32d/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:00:59.945856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6a72a-43cb-4d7f-8d4f-ddcc9be73f46 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:59.946384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6a72a-43cb-4d7f-8d4f-ddcc9be73f46 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:59.946384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6a72a-43cb-4d7f-8d4f-ddcc9be73f46 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:59.948481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 209/415] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:00:59.958898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a141-e89d-419e-ab66-cba244946f29 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:00:59.959434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a141-e89d-419e-ab66-cba244946f29 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:00:59.959434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a141-e89d-419e-ab66-cba244946f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:00:59.979496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6408a141-e89d-419e-ab66-cba244946f29 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:00:59.981482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6408a141-e89d-419e-ab66-cba244946f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:00.038488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0792-4241-4fd1-855f-fc076e8a3860 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.038816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0792-4241-4fd1-855f-fc076e8a3860 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.039053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e0792-4241-4fd1-855f-fc076e8a3860 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.041205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 210/416] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:00.047744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd18574-825b-416b-9be0-895270bb3379 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.048041 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd18574-825b-416b-9be0-895270bb3379 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.048419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd18574-825b-416b-9be0-895270bb3379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.050022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 207/417] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:00:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:00.069295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8bd18574-825b-416b-9be0-895270bb3379 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:00.070544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8bd18574-825b-416b-9be0-895270bb3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:00.078958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 211/418] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:00.089030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a141-e89d-419e-ab66-cba244946f29 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.099216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a141-e89d-419e-ab66-cba244946f29 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.104492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd18574-825b-416b-9be0-895270bb3379 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.109847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.110943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.111222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.112105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.117916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd18574-825b-416b-9be0-895270bb3379 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.127653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.128463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.128881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.129196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.138048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:00.145852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:01:00.147344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 208/419] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:00.151661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:00.153327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.164998 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 18:01:00.171692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2413b1d-8195-4791-9b75-4cb34ec5d7f6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.177701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 212/420] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:00.180921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.181629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.181914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.182194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.182944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:00.183250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.185553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.189595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.203819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f1c8d-db90-4242-9825-94838cbec3b4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.208319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.208992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.209306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.209587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.210337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:00.210642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.212259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.219001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 209/421] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:00.226721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.229665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 213/422] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:00.235189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.239955 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921659-5274-46de-9221-593f8a66a648 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.253844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.255878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42842c03-2a1f-4a1d-b6d7-6eb55136798c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.256533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.256823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.257108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.265191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.265914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.266200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.266480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.275179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.276995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.278785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.280550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.287824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 214/423] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:01:00.293537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.300200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 210/424] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:00.304596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b2a1-2af5-49cd-a6df-ed7c6689f1b6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.307567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.310303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.311518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.312037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.312530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.314000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.316447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.318760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 215/425] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:00.325182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.326636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9745c-dd65-40db-9b0d-127f19f9c7f5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.342372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.343711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.344263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.344742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.345893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef85a-ac1c-4856-996e-27fc49c8908c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.346842 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.350853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.355983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 211/426] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:00.365115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.366730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.373179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.374925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.375860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.381695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.389705 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.395394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 216/427] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:00.405840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.407883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f3561-26d3-4da5-855d-4534a6348fa9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.425385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d18863-7718-4572-bdd8-43ce3ac12a32 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.428802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.429738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.430101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.430389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.436309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad9156-4909-4010-a2d2-e9baec7b210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.437942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9156-4909-4010-a2d2-e9baec7b210a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.438131 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.438897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9156-4909-4010-a2d2-e9baec7b210a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.439771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad9156-4909-4010-a2d2-e9baec7b210a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.440042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.441942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9156-4909-4010-a2d2-e9baec7b210a admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=aea7aefae5004978a40b0657cb85a6c5) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:00.442290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 212/428] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:00.443249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9156-4909-4010-a2d2-e9baec7b210a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.452261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad9156-4909-4010-a2d2-e9baec7b210a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.467770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 217/429] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 611 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:00.476162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.492148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcec301-12bf-457b-b7b2-105fe5e47d85 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.504547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2d43d-0083-41c3-9e6a-6c9a0be62070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.506201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d43d-0083-41c3-9e6a-6c9a0be62070 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.507019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d43d-0083-41c3-9e6a-6c9a0be62070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.507839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d43d-0083-41c3-9e6a-6c9a0be62070 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.509881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d43d-0083-41c3-9e6a-6c9a0be62070 admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=49988fd7322b428281a0ca4fe1b6fd51, scope.project.id=32d4a5ac6711498799101bfed49ee0ba) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:00.510806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d43d-0083-41c3-9e6a-6c9a0be62070 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.514489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d43d-0083-41c3-9e6a-6c9a0be62070 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.527063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 213/430] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=49988fd7322b428281a0ca4fe1b6fd51 => generated 611 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:00.795285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6594-2a5f-40ff-8d01-5d1202af5cd7 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.795953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6594-2a5f-40ff-8d01-5d1202af5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.796441 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6594-2a5f-40ff-8d01-5d1202af5cd7 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.798926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 218/431] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:00.804737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f04675-685e-42ea-b533-31ae907e5031 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.805395 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f04675-685e-42ea-b533-31ae907e5031 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.805908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f04675-685e-42ea-b533-31ae907e5031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.829667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-01f04675-685e-42ea-b533-31ae907e5031 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:00.831306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-01f04675-685e-42ea-b533-31ae907e5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:00.841292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 214/432] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:00.874668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a6594-2a5f-40ff-8d01-5d1202af5cd7 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.895278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a6594-2a5f-40ff-8d01-5d1202af5cd7 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.903696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.904517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.904792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.905063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.918894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:00.927072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:01:00.930878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 219/433] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:00.937176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f04675-685e-42ea-b533-31ae907e5031 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.949796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f04675-685e-42ea-b533-31ae907e5031 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.955860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.956542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.956820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.957125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:00.957931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:00.958233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:00.959959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:00.969816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 215/434] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:00.975011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:00.987819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f02142-95f5-4024-9e16-125a9e00d6c6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:00.997838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:00.998499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:00.998779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:00.999050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.009036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.010879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.021592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 220/435] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:01.027383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.041058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d3b2a-a938-4306-9b63-424d617d9dd9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.047588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.048862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.049456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.049948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] PATH_INFO: `/v3/projects/32d4a5ac6711498799101bfed49ee0ba` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.051559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] RBAC: Authorizing `identity:get_project(project_id=32d4a5ac6711498799101bfed49ee0ba)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.054258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.056248 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 216/436] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/projects/32d4a5ac6711498799101bfed49ee0ba => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:01.063090 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.073275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079c73-c80d-4833-bf65-624cdd615371 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.079686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b89ea0-2807-4e94-8461-a9de0addc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.080688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89ea0-2807-4e94-8461-a9de0addc20a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.080970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89ea0-2807-4e94-8461-a9de0addc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.081314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89ea0-2807-4e94-8461-a9de0addc20a admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.084357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b89ea0-2807-4e94-8461-a9de0addc20a admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.086370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b89ea0-2807-4e94-8461-a9de0addc20a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.087668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 221/437] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:01.093395 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.103766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a39d5-6834-4f24-b1b1-61e80220b03f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.111175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e88f6-8820-4030-bf2f-403320e4661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.111850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e88f6-8820-4030-bf2f-403320e4661d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.112130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e88f6-8820-4030-bf2f-403320e4661d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.112405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e88f6-8820-4030-bf2f-403320e4661d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.113285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e88f6-8820-4030-bf2f-403320e4661d admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=dc6090b70eff456892de81377068fadd, scope.project.id=32d4a5ac6711498799101bfed49ee0ba) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:01.113594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e88f6-8820-4030-bf2f-403320e4661d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.115439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e88f6-8820-4030-bf2f-403320e4661d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.123458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 217/438] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=32d4a5ac6711498799101bfed49ee0ba&role.id=dc6090b70eff456892de81377068fadd => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:01.268315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2521-c6b6-453d-a9f9-d312b0b6e13b None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.268960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2521-c6b6-453d-a9f9-d312b0b6e13b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.269557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2521-c6b6-453d-a9f9-d312b0b6e13b None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.273249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 222/439] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:01.282922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1fc4-bf91-4881-bcd3-72b0d3f2d1fe None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.283650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1fc4-bf91-4881-bcd3-72b0d3f2d1fe None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.284355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1fc4-bf91-4881-bcd3-72b0d3f2d1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.313510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f2db1fc4-bf91-4881-bcd3-72b0d3f2d1fe None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:01.314622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f2db1fc4-bf91-4881-bcd3-72b0d3f2d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:01.333152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 218/440] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:01.353668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff2521-c6b6-453d-a9f9-d312b0b6e13b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.368903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff2521-c6b6-453d-a9f9-d312b0b6e13b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.376844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.378416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.379043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.379666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.396112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:01.404646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:01:01.405902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 223/441] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:01.411661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db1fc4-bf91-4881-bcd3-72b0d3f2d1fe None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.422055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db1fc4-bf91-4881-bcd3-72b0d3f2d1fe None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.428330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.428998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.429318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.429584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.430326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:01.430630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.432206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.442355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 219/442] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:01.447811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.458072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354283b-0b95-48df-90ef-2c966fc79c9b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.462884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.463639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.464143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.464397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.474694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.476480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.488167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 224/443] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:01:01.493854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.504954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941787d-5521-43c4-bac7-4b8a83faa5e8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.509762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.510736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.511117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.511490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] PATH_INFO: `/v3/projects/aea7aefae5004978a40b0657cb85a6c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.514076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] RBAC: Authorizing `identity:get_project(project_id=aea7aefae5004978a40b0657cb85a6c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.516115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.517868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 220/444] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/projects/aea7aefae5004978a40b0657cb85a6c5 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:01.523611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.534463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afee64a-5c89-4b74-bf22-2b7dc81f6501 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.539392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bc992-67d5-438d-9e39-f3f72bdfb338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.540252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc992-67d5-438d-9e39-f3f72bdfb338 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.540528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc992-67d5-438d-9e39-f3f72bdfb338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.540797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc992-67d5-438d-9e39-f3f72bdfb338 admin admin] PATH_INFO: `/v3/groups/2610ff6184c641f8a20b4f15fc36f144` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.542101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bc992-67d5-438d-9e39-f3f72bdfb338 admin admin] RBAC: Authorizing `identity:get_group(group_id=2610ff6184c641f8a20b4f15fc36f144)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.544050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bc992-67d5-438d-9e39-f3f72bdfb338 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.546003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 225/445] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/groups/2610ff6184c641f8a20b4f15fc36f144 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:01.551988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:01.561802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a9e83-df03-41a6-b59d-21b0c2a26e37 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:01.567076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b658c1-453e-4417-997f-1b23a4080164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:01.567669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b658c1-453e-4417-997f-1b23a4080164 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:01.567954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b658c1-453e-4417-997f-1b23a4080164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:01.568230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b658c1-453e-4417-997f-1b23a4080164 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:01.569059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b658c1-453e-4417-997f-1b23a4080164 admin admin] RBAC: Adding query filter params (group.id=2610ff6184c641f8a20b4f15fc36f144, role.id=dc6090b70eff456892de81377068fadd, scope.project.id=aea7aefae5004978a40b0657cb85a6c5) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:01.569410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b658c1-453e-4417-997f-1b23a4080164 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:01.571252 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b658c1-453e-4417-997f-1b23a4080164 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:01.581164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 221/446] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:01:01 2022] GET /identity/v3/role_assignments?group.id=2610ff6184c641f8a20b4f15fc36f144&scope.project.id=aea7aefae5004978a40b0657cb85a6c5&role.id=dc6090b70eff456892de81377068fadd => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:02.288337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62c22f-3857-4990-85a3-f3311003af37 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.288861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62c22f-3857-4990-85a3-f3311003af37 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.288861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62c22f-3857-4990-85a3-f3311003af37 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.290730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 226/447] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:02.297163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffaa2-6c00-4dbf-95d4-d70ad980ae02 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.297853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffaa2-6c00-4dbf-95d4-d70ad980ae02 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.297853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffaa2-6c00-4dbf-95d4-d70ad980ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.317073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-351ffaa2-6c00-4dbf-95d4-d70ad980ae02 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:02.318303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-351ffaa2-6c00-4dbf-95d4-d70ad980ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:02.325770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 222/448] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:02.350546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62c22f-3857-4990-85a3-f3311003af37 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:02.366193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62c22f-3857-4990-85a3-f3311003af37 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:02.370408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:02.372546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.372842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.373141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.384085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:02.392172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:01:02.393516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 227/449] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:02.399471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ffaa2-6c00-4dbf-95d4-d70ad980ae02 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:02.408890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ffaa2-6c00-4dbf-95d4-d70ad980ae02 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:02.414298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:02.415074 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.415448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.415815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.416731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:02.417180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:02.419988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:02.430060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 223/450] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:02.436859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:02.447249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8041a-3740-41f9-9740-6c1c9804015e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:02.452012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:02.452683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.452969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.453287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.462650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:02.464452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:02.474554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 228/451] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:02.480224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:02.491050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4830dd9-ede6-4fb9-b6f5-c73766f8a589 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:02.495466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:02.497206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.497206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.497822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] PATH_INFO: `/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.499265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] RBAC: Authorizing `identity:get_project(project_id=cbda6004e23b4962aaf44dfcd57b21b1)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:02.501058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:02.502830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 224/452] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:01:02 2022] GET /identity/v3/projects/cbda6004e23b4962aaf44dfcd57b21b1 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:02.508716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:02.519310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afc63c-fb12-4ad1-97cb-469393f30237 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:02.526169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71eff7f-4df9-426f-a632-d45ab25feabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:02.527675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eff7f-4df9-426f-a632-d45ab25feabf admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.528321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eff7f-4df9-426f-a632-d45ab25feabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.528833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71eff7f-4df9-426f-a632-d45ab25feabf admin admin] PATH_INFO: `/v3/groups/917f3014ca62435daf46e734b874d32d` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.530863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71eff7f-4df9-426f-a632-d45ab25feabf admin admin] RBAC: Authorizing `identity:get_group(group_id=917f3014ca62435daf46e734b874d32d)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:02.534407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71eff7f-4df9-426f-a632-d45ab25feabf admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:02.537350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 229/453] 10.222.0.87 () {56 vars in 1201 bytes} [Wed Feb 16 18:01:02 2022] GET /identity/v3/groups/917f3014ca62435daf46e734b874d32d => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:02.543686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:02.554275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fdb6-da70-43e0-a170-cb4b5a5d5618 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:02.559883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496999f-5c97-47a1-a178-c14540ae5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:02.560535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496999f-5c97-47a1-a178-c14540ae5867 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:02.560824 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496999f-5c97-47a1-a178-c14540ae5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:02.561125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496999f-5c97-47a1-a178-c14540ae5867 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:02.561956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496999f-5c97-47a1-a178-c14540ae5867 admin admin] RBAC: Adding query filter params (group.id=917f3014ca62435daf46e734b874d32d, role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=cbda6004e23b4962aaf44dfcd57b21b1) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:02.562266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496999f-5c97-47a1-a178-c14540ae5867 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:02.564102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496999f-5c97-47a1-a178-c14540ae5867 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:02.570897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 225/454] 10.222.0.87 () {56 vars in 1397 bytes} [Wed Feb 16 18:01:02 2022] GET /identity/v3/role_assignments?group.id=917f3014ca62435daf46e734b874d32d&scope.project.id=cbda6004e23b4962aaf44dfcd57b21b1&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:05.514374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbe7e-8887-4cad-a912-04a475f829c7 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:05.515470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbe7e-8887-4cad-a912-04a475f829c7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:05.515973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dbe7e-8887-4cad-a912-04a475f829c7 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:05.518491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 230/455] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:05.524796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b5ea-91d9-418c-9033-1d71c23d738e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:05.525806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b5ea-91d9-418c-9033-1d71c23d738e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:05.526334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b5ea-91d9-418c-9033-1d71c23d738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:05.559089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c765b5ea-91d9-418c-9033-1d71c23d738e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:05.561327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c765b5ea-91d9-418c-9033-1d71c23d738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:05.578508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 226/456] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:05.605944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbe7e-8887-4cad-a912-04a475f829c7 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:05.625488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dbe7e-8887-4cad-a912-04a475f829c7 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:05.638065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:05.639514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:05.640066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:05.640576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:05.658388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:05.661165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:05.689779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:05.696424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 231/457] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:05.698956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b5ea-91d9-418c-9033-1d71c23d738e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:05.728014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b5ea-91d9-418c-9033-1d71c23d738e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:05.744754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:05.745986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:05.746564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:05.747090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:05.748570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:05.749171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:05.751035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:05.751035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:05.751035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:05.752743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431677e4-9563-40e6-8fee-b88160e636c0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:05.800136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 227/458] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:05.806338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:05.823134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4fc30-fa6f-4bc3-84ae-22a43422534c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:05.840486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973aca6-c176-4c76-8170-132e5071381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:05.842241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973aca6-c176-4c76-8170-132e5071381d admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:05.843079 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973aca6-c176-4c76-8170-132e5071381d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:05.843703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973aca6-c176-4c76-8170-132e5071381d admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:05.844696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973aca6-c176-4c76-8170-132e5071381d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:05.846945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973aca6-c176-4c76-8170-132e5071381d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:05.948908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 232/459] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:01:05 2022] POST /identity/v3/users => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:06.401475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da1be-2493-4c93-be5a-50952a4cebb3 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.402008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da1be-2493-4c93-be5a-50952a4cebb3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.403041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6da1be-2493-4c93-be5a-50952a4cebb3 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.406721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 228/460] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:06.416193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2ce7-348f-4294-b973-f16b8014a2b2 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.416486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2ce7-348f-4294-b973-f16b8014a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.416813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2ce7-348f-4294-b973-f16b8014a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.440066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d00e2ce7-348f-4294-b973-f16b8014a2b2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:06.441364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d00e2ce7-348f-4294-b973-f16b8014a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:06.460370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 233/461] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:06.482849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da1be-2493-4c93-be5a-50952a4cebb3 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:06.503468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6da1be-2493-4c93-be5a-50952a4cebb3 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:06.511918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:06.513389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.514101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.514763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.534736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:06.537625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:06.564623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:06.566653 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 229/462] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:06.572686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e2ce7-348f-4294-b973-f16b8014a2b2 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:06.587416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e2ce7-348f-4294-b973-f16b8014a2b2 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:06.594044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76a0fa-d117-4cbd-88e9-0e833b9b51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:06.594885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a0fa-d117-4cbd-88e9-0e833b9b51be admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.595175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a0fa-d117-4cbd-88e9-0e833b9b51be admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.595526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a0fa-d117-4cbd-88e9-0e833b9b51be admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.596299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a0fa-d117-4cbd-88e9-0e833b9b51be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:06.596611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a0fa-d117-4cbd-88e9-0e833b9b51be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:06.598303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a0fa-d117-4cbd-88e9-0e833b9b51be admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:06.615514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 234/463] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:06.621215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:06.632678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0db55f-a27f-4a4e-9dc6-12a8d760a97d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:06.638484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:06.639190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.639490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.639821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.640596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:06.642726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:06.681259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efc042-d703-48a3-a178-3824bf01da2b None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.681597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efc042-d703-48a3-a178-3824bf01da2b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.681883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efc042-d703-48a3-a178-3824bf01da2b None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.684179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 235/464] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:06.690685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87984-cef5-46a4-836e-229515560f41 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.691273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87984-cef5-46a4-836e-229515560f41 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.691846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87984-cef5-46a4-836e-229515560f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.713847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-91e87984-cef5-46a4-836e-229515560f41 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:06.716915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-91e87984-cef5-46a4-836e-229515560f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:06.725727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 236/465] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:06.744189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 230/466] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:01:06 2022] POST /identity/v3/users => generated 248 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:06.753473 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e87984-cef5-46a4-836e-229515560f41 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:06.764039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e87984-cef5-46a4-836e-229515560f41 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:06.774919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:06.776050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.776590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.777144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.792907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:06.802203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:06.823696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:06.827888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 237/467] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:06.833496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:06.852960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96dafc-03cb-4126-bd0a-011500c58adb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:06.868146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefc9bb-8778-4484-b28e-595861e40389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:06.869339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc9bb-8778-4484-b28e-595861e40389 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.869842 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc9bb-8778-4484-b28e-595861e40389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.870341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefc9bb-8778-4484-b28e-595861e40389 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.871598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefc9bb-8778-4484-b28e-595861e40389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:06.871914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefc9bb-8778-4484-b28e-595861e40389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:06.873938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefc9bb-8778-4484-b28e-595861e40389 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:06.899599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 231/468] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:06.906197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:06.917345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e7e07-11cd-409a-8266-8f031d70d1c1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:06.930263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:06.931415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.931891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.932486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.933468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:06.935812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:06.938743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa9ac-0586-4887-9fb8-c8ce8f0abb92 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.939036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa9ac-0586-4887-9fb8-c8ce8f0abb92 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.939319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa9ac-0586-4887-9fb8-c8ce8f0abb92 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.941481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 232/469] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:06.946829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a54d-0856-47a8-9009-1d09190f3a62 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:06.947135 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a54d-0856-47a8-9009-1d09190f3a62 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:06.947393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962a54d-0856-47a8-9009-1d09190f3a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:06.972296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c962a54d-0856-47a8-9009-1d09190f3a62 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:06.973501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c962a54d-0856-47a8-9009-1d09190f3a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:06.984487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 233/470] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:07.016124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962a54d-0856-47a8-9009-1d09190f3a62 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:07.028952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962a54d-0856-47a8-9009-1d09190f3a62 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:07.033498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:07.034313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.034598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.034879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.047998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:07.049884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:07.064385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 238/471] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:01:06 2022] POST /identity/v3/users => generated 249 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:07.077752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:07.079395 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 234/472] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:07.086083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:07.102968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fc159-ce0b-4f51-9f56-d9d80c673949 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:07.110188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77934be-52b6-41ce-8018-4021dcf4c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:07.110870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77934be-52b6-41ce-8018-4021dcf4c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.111207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77934be-52b6-41ce-8018-4021dcf4c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.111580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77934be-52b6-41ce-8018-4021dcf4c8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.112325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77934be-52b6-41ce-8018-4021dcf4c8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:07.112631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77934be-52b6-41ce-8018-4021dcf4c8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:07.114470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77934be-52b6-41ce-8018-4021dcf4c8ed admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:07.130973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 239/473] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:07.138150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:07.152075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d0f1-4793-434e-8c36-1a533d73e456 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:07.158046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88845b27-32b4-4500-9a82-f7aff47a3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:07.158795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845b27-32b4-4500-9a82-f7aff47a3e95 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.159081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845b27-32b4-4500-9a82-f7aff47a3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.159358 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88845b27-32b4-4500-9a82-f7aff47a3e95 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.160209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88845b27-32b4-4500-9a82-f7aff47a3e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:07.162465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88845b27-32b4-4500-9a82-f7aff47a3e95 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:07.248431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 235/474] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:01:07 2022] POST /identity/v3/users => generated 248 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:07.683002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eeb77-0e43-4db0-8153-c681bee299bb None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.683739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eeb77-0e43-4db0-8153-c681bee299bb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.683739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eeb77-0e43-4db0-8153-c681bee299bb None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.685814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 240/475] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:07.693818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2afb8a-e0ce-482e-b1e7-e2d54f998e1f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.694557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2afb8a-e0ce-482e-b1e7-e2d54f998e1f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.694557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2afb8a-e0ce-482e-b1e7-e2d54f998e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.724031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7d2afb8a-e0ce-482e-b1e7-e2d54f998e1f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:07.725598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7d2afb8a-e0ce-482e-b1e7-e2d54f998e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:07.739854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 236/476] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:07.765629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eeb77-0e43-4db0-8153-c681bee299bb None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:07.790899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eeb77-0e43-4db0-8153-c681bee299bb None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:07.795730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:07.796402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.796684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.796957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.797740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:07.799421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:07.838310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.sql.core [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 16 18:01:07.838310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 16 18:01:07.838310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [parameters: {'id': '383643ad969f4834b1fa76e6d78a842f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 16 18:01:07.838310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79635) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 18:01:07.857374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 16 18:01:07.859166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 241/477] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:01:07 2022] POST /identity/v3/roles => generated 144 bytes in 94 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:07.864621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2afb8a-e0ce-482e-b1e7-e2d54f998e1f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:07.878793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2afb8a-e0ce-482e-b1e7-e2d54f998e1f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:07.886264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166b349-7d96-4e67-aae8-d70135f4212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:07.888072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b349-7d96-4e67-aae8-d70135f4212b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.888687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b349-7d96-4e67-aae8-d70135f4212b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.893255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166b349-7d96-4e67-aae8-d70135f4212b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.909412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166b349-7d96-4e67-aae8-d70135f4212b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:07.917103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-5166b349-7d96-4e67-aae8-d70135f4212b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 18:01:07.919113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 237/478] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:07.926574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:07.947794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc980b5-f748-4b11-9df6-43442be0f00f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:07.958811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7428272-d022-4c73-92ca-147fd5593722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:07.959574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7428272-d022-4c73-92ca-147fd5593722 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:07.959865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7428272-d022-4c73-92ca-147fd5593722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:07.960142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7428272-d022-4c73-92ca-147fd5593722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:07.960958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7428272-d022-4c73-92ca-147fd5593722 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:07.961290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7428272-d022-4c73-92ca-147fd5593722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:07.962959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7428272-d022-4c73-92ca-147fd5593722 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:07.975946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 242/479] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:09.314650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662908-dbb4-4e5a-b454-c2f1c204777a None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.315635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662908-dbb4-4e5a-b454-c2f1c204777a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.316115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7662908-dbb4-4e5a-b454-c2f1c204777a None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.318211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 238/480] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:09.323750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f1f9-79b9-4878-8fac-b2831a031dbe None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.325206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f1f9-79b9-4878-8fac-b2831a031dbe None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.325769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f1f9-79b9-4878-8fac-b2831a031dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.354288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0a84f1f9-79b9-4878-8fac-b2831a031dbe None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:09.356319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0a84f1f9-79b9-4878-8fac-b2831a031dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:09.364756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 243/481] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:09.403450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662908-dbb4-4e5a-b454-c2f1c204777a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.424428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7662908-dbb4-4e5a-b454-c2f1c204777a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.429761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.430569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.430854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.431130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.451243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:09.458783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:09.460275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 239/482] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:09.466010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f1f9-79b9-4878-8fac-b2831a031dbe None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.483707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f1f9-79b9-4878-8fac-b2831a031dbe None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.493108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.494104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.494596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.495049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.496497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:09.496990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:09.499004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:09.515976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 244/483] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:09.521286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.534475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb1b8-3a90-46dd-87b7-10df724b2d42 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.545103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.545925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.546210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.546491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.568559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:09.570508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:09.597870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:09.599121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 240/484] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:09.604626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.624715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcb6b7-bb3a-4553-8fdb-8eacae16bdc1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.634944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.636034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.636484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.641302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.642142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:09.642461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:09.644087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:09.669015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 245/485] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:09.674527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.692332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6745d-d7af-48e4-8139-21e8c18b7148 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.701224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.702155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.702385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.702715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.722418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:09.724541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:09.742715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:01:09.744009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 241/486] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:09.751012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.767674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185db73a-160b-4976-a027-eb57ab4ef7ab admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.772138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.772822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.773112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.773394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.774232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:09.774536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:09.775562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:09.775562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:01:09.775562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:01:09.776689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126de818-c27b-4a35-abe2-16e3fa25b54a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:09.836524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 246/487] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:09.842487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.859028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12102a-fb2b-4f67-b44b-4c8dd39b828b None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.859315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12102a-fb2b-4f67-b44b-4c8dd39b828b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.859583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12102a-fb2b-4f67-b44b-4c8dd39b828b None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.859863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c4ac2-ad98-4ac0-8b35-02483a12e10d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.861727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 247/488] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:09.867841 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.868331 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15d64e-9084-4df9-8ba6-75ccc6ce845a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.868601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.868838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15d64e-9084-4df9-8ba6-75ccc6ce845a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.868996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.869167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.869354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15d64e-9084-4df9-8ba6-75ccc6ce845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.885370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:09.887461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:09.905167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 242/489] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:09.911089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:09.927485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d91fe-0595-425a-80c3-de600540ff22 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:09.939626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:09.940505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:09.940802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:09.941101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:09.966301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:09.968337 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.000350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:10.010080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 243/490] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:10.015657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.031674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d62ac-3cb4-4f07-89df-7cbe16f6de9a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.031867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-4a15d64e-9084-4df9-8ba6-75ccc6ce845a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:10.032954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4a15d64e-9084-4df9-8ba6-75ccc6ce845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:10.042429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.043745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.044322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.044742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.045191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 248/491] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:10.045713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.046029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.047823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.070126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15d64e-9084-4df9-8ba6-75ccc6ce845a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.075341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 244/492] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:10.080887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.084396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15d64e-9084-4df9-8ba6-75ccc6ce845a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.094718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05b1b-2a21-4eee-922c-220a59beabe0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.097762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.098666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.098955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.099233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.105788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.107824 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.108108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.108404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.123956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:10.127671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.129748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.141301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:10.142801 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 249/493] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:10.149119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.150286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:10.151849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 245/494] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:10.157766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.168959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fffaf-f9ea-4945-80b1-076f9c106760 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.171721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be499fa8-fe00-422f-9cdd-1156de0f20b5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.174014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.174846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.175312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.175666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.176694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.177365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.178624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:10.178624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:10.178624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:10.179913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.187059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.188089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.188565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.189024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.190035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.190572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.192495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.210332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 246/495] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:10.215618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 250/496] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:10.222580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.223773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.234022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0c9b7-4cfe-429a-bb27-1463b93de9f5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.239276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.240267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.240773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.241316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.242455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=28dfb9c84dda4d6799a490a009e867df) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.242977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.245218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.245452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb85b3a-bd3a-44ff-b201-0dd8f68db9da admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.253822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 247/497] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/role_assignments?user.id=28dfb9c84dda4d6799a490a009e867df&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:10.270667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.271496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.271775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.272176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.294878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.296783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.329341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:10.330625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 251/498] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:10.337029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.357548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215463-f9df-470e-96f2-8f96dd7f1a98 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.369384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2cf34-0caf-4b9e-b10d-66d63dcf051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.370515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2cf34-0caf-4b9e-b10d-66d63dcf051c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.371648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2cf34-0caf-4b9e-b10d-66d63dcf051c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.372240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2cf34-0caf-4b9e-b10d-66d63dcf051c admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.373266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2cf34-0caf-4b9e-b10d-66d63dcf051c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.373784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2cf34-0caf-4b9e-b10d-66d63dcf051c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.375713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2cf34-0caf-4b9e-b10d-66d63dcf051c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.394623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 248/499] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:10.400239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.415205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f8853-d263-4bbe-8f33-67d4685ff0c6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.418216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7006f-ae96-40f1-bfbc-0764475573d9 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.418631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7006f-ae96-40f1-bfbc-0764475573d9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.418924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7006f-ae96-40f1-bfbc-0764475573d9 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.420987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.421457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 249/500] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:10.422508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.423011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.423489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.431513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d5e1-ea02-47a9-885d-58621811f726 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.431853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d5e1-ea02-47a9-885d-58621811f726 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.432152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d5e1-ea02-47a9-885d-58621811f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.435257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.437703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.454131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 18:01:10.456463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 252/501] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:10.461988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.473852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827535-7ac7-4af6-a1cb-d9239772736f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.479715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.480913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.481431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.481984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.483159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.483682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.486428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.506373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-edc4d5e1-ea02-47a9-885d-58621811f726 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:10.507702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-edc4d5e1-ea02-47a9-885d-58621811f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:10.508725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 253/502] 10.222.0.87 () {56 vars in 1158 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:10.515388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.526996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 250/503] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:10.531097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93229110-27b7-4112-9ef3-56fff61e7c5e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.536414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.537458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.537745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.538165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.549013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.551396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.563339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 254/504] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:10.563739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4d5e1-ea02-47a9-885d-58621811f726 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.568883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.580102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a3dc-1684-4c7c-b276-abe3f71019f1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.586555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4d5e1-ea02-47a9-885d-58621811f726 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.591453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.593737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.594819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.595793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.599435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.601436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.602077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.602785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.615210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.616508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:10.617034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.624984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:10.627038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 251/505] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:10.632527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.644607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943c447-3593-4c88-b046-b0d2f144bcef admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.645999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:10.650024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fa13a-92b8-4f25-b860-a67543ed5451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.651029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fa13a-92b8-4f25-b860-a67543ed5451 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.651516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fa13a-92b8-4f25-b860-a67543ed5451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.652028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fa13a-92b8-4f25-b860-a67543ed5451 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.653639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 255/506] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:10.654249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fa13a-92b8-4f25-b860-a67543ed5451 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.654894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fa13a-92b8-4f25-b860-a67543ed5451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.656817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fa13a-92b8-4f25-b860-a67543ed5451 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.659295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.668042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 252/507] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:10.671128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882aac-6586-4caf-b14f-8501ae5a00a5 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.671965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882aac-6586-4caf-b14f-8501ae5a00a5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.672490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22882aac-6586-4caf-b14f-8501ae5a00a5 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.674989 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 253/508] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:10.677552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22882aac-6586-4caf-b14f-8501ae5a00a5 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.677910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a13cf7-ff73-4844-9574-2b2246cbfd34 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.686845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca36c4-8462-4fdd-917b-e0a982d5bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.688225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca36c4-8462-4fdd-917b-e0a982d5bd98 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.688225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca36c4-8462-4fdd-917b-e0a982d5bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.688429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca36c4-8462-4fdd-917b-e0a982d5bd98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.689228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca36c4-8462-4fdd-917b-e0a982d5bd98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.689607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca36c4-8462-4fdd-917b-e0a982d5bd98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.691541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca36c4-8462-4fdd-917b-e0a982d5bd98 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.694178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22882aac-6586-4caf-b14f-8501ae5a00a5 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.700389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.702169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.702670 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.703137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.711721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 256/509] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:10.713418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b449ee-663b-4c3c-9202-883923f96fc3 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.713927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b449ee-663b-4c3c-9202-883923f96fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.714392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b449ee-663b-4c3c-9202-883923f96fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.718263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.720490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.737645 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-07b449ee-663b-4c3c-9202-883923f96fc3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:10.739329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-07b449ee-663b-4c3c-9202-883923f96fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:10.742874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:10.745240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 254/510] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:10.746513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.754894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 257/511] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:10.755953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b449ee-663b-4c3c-9202-883923f96fc3 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.762884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d834402-0b17-4bd9-9ced-4c99b483cfbd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.775308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b449ee-663b-4c3c-9202-883923f96fc3 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.779572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.780880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.781497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.782071 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.794307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.795283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.795503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.795841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.796576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.796887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.798119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.798585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.800713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.811648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 258/512] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:10.812517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.819507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:10.826328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274b90-708d-4911-a90f-245ab9465b4f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.826527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 255/513] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:10.826527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.835406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.837462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.838198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.838532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5b91-0567-4e98-ac98-306ced4caf60 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.839209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.845397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.846301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.846785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.847184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.856683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:10.857323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.859589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.866699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:10.868444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 259/514] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:10.874959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.875577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 18:01:10.877259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 256/515] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:10.878265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.889285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895264a-b70a-4a92-b44c-acbdaa283ca7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.891154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fd17-9a6b-4761-8e68-ad960a29191e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.895227 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.896189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.896503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.896993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.897141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.897495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.897785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.897893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.898783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.899071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.899171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.899631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.900861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:10.900861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:01:10.900861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:01:10.901153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.902558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.912859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 257/516] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:10.913944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.929139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb103a6-14fa-43de-97d8-0f1ee864a87a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.936989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 260/517] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:10.936989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:10.943906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.944898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.945365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.945830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.946822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:10.947344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.948565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:10.948565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:10.948565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:10.949128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0638e-cf65-43cf-ac8b-cb416a1b3a3a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:10.951279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.954939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:10.955925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:10.956322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:10.956696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:10.969117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:10.971143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:10.989448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:10.995270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 261/518] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:10.995270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.002311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 258/519] 10.222.0.87 () {56 vars in 1160 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.003660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.007414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209d66-a2bc-48a3-9d2c-b5a059b89bac admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.013792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.014680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.015072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.015458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.016515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=715e34300eef47d9aa2839cb3c5c5fae) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.016976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.017232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642aae3-6175-4492-86f5-d188d165a98b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.019233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.022211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.023132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.023605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.024066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.025449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.026062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.031259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 262/520] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:10 2022] GET /identity/v3/role_assignments?user.id=715e34300eef47d9aa2839cb3c5c5fae&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.031259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.033496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.053129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35512773-39ea-4c3c-9ab2-b70cf00db361 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.058159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.058915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.059770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.059770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.067737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 259/521] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.069888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.071763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.074836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.083425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 263/522] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:11.092890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.097404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c15b-61b6-440b-b3a3-49c763cb45bf admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.102175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.103075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.103365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.103641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.112034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5976c8-6c36-44b1-b88e-0b3041331fe6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.114046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.116191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.126533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.127353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.127634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.127913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.136462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 18:01:11.147595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 260/523] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:11.148451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.150342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.154624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.171111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827be65-7f4f-4c1f-9afd-c608c387144e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.175811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.176499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.176780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.177345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.178197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.178503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.180381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.187075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:11.188686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 264/524] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:11.198160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.211940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 261/525] 10.222.0.87 () {56 vars in 1158 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.218667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.221166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc077b-8cfc-4597-a15f-61b45d0814a1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.234494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.235483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.237326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.237820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.240620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09f1c6-2d3d-431d-a1d1-494982a69e33 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.241938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.242411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.244376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.253009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.256095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.256516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.257014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.271309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 265/526] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.275347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.277025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.279118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.291434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af775-133e-4c53-962d-9e4ff604f62c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.297225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 262/527] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:11.304192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.305649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d12a-fef2-4e37-8814-f24c77520231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.306587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d12a-fef2-4e37-8814-f24c77520231 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.306941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d12a-fef2-4e37-8814-f24c77520231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.307287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d12a-fef2-4e37-8814-f24c77520231 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.318354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d12a-fef2-4e37-8814-f24c77520231 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.320515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d12a-fef2-4e37-8814-f24c77520231 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.323443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91ed1-41ff-4351-8db2-c15f1daf5dfa admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.330514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4d13f-a145-4d54-b3e7-e6cc0a0a5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.331322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4d13f-a145-4d54-b3e7-e6cc0a0a5239 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.331660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4d13f-a145-4d54-b3e7-e6cc0a0a5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.331935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4d13f-a145-4d54-b3e7-e6cc0a0a5239 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.335502 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6d23d12a-fef2-4e37-8814-f24c77520231 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:11.337169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 266/528] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:11.338734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777de85-b522-4ca7-8a48-0566b0fbf017 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.339154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777de85-b522-4ca7-8a48-0566b0fbf017 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.339558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777de85-b522-4ca7-8a48-0566b0fbf017 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.341847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 267/529] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:11.344902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4d13f-a145-4d54-b3e7-e6cc0a0a5239 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.346367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777de85-b522-4ca7-8a48-0566b0fbf017 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.346932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4d13f-a145-4d54-b3e7-e6cc0a0a5239 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.361496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777de85-b522-4ca7-8a48-0566b0fbf017 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.366981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.367655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.367943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.368228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.368353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-99c4d13f-a145-4d54-b3e7-e6cc0a0a5239 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:11.369026 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.369388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.369909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 263/530] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:11.372030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f1009-b11f-4df7-8337-d0049bf20602 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.372307 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f1009-b11f-4df7-8337-d0049bf20602 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.372418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.372583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f1009-b11f-4df7-8337-d0049bf20602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.386304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 268/531] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.387642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.392759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6a4f1009-b11f-4df7-8337-d0049bf20602 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:11.394254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6a4f1009-b11f-4df7-8337-d0049bf20602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:11.398406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878acceb-f2de-4146-aa99-d8ac26b91376 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.403295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 264/532] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:11.403693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.404312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f1009-b11f-4df7-8337-d0049bf20602 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.404417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.404639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.404918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.405702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.406013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.407858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.414596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f1009-b11f-4df7-8337-d0049bf20602 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.420536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.429565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 269/533] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.429767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.429767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.430059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.431072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=9b842d30b55c48bf8f375bdcc829bf57) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.431390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.434654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.435943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.440950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 265/534] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/role_assignments?user.id=9b842d30b55c48bf8f375bdcc829bf57&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.455054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.458571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5aae9-7d99-4a32-8be3-a3ea894b7d18 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.468726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0749-0cd8-44a6-bbcd-a563bae4487d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.474227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.475149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.475334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.475718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.476089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.476608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.477437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.478129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.490410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.492795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.515007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:11.515409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.516508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 266/535] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:11.519795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.532816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.548769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db626-6de7-4d6a-908f-52256271460f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.555141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:11.556971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 270/536] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:11.560116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.561177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.561604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.562022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.562935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.563401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.565326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.566527 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.585593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6a9e8-c6c0-435a-8159-56c714578c61 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.598087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.600205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.600785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 267/537] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:11.601336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.601973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.603353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.603864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.606137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.609462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.628487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c908-e4ec-4cbe-b79f-b36d14040c23 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.639764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c139c-b800-4383-a858-3141c911bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.641274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 271/538] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:11.642469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c139c-b800-4383-a858-3141c911bd51 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.643152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c139c-b800-4383-a858-3141c911bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.643785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c139c-b800-4383-a858-3141c911bd51 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.645247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c139c-b800-4383-a858-3141c911bd51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.647868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c139c-b800-4383-a858-3141c911bd51 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.649962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:11.664089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b362c-d072-4a48-a4a5-761d232033ac admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:11.673762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf3fc5-69eb-4cce-a04c-093d7392f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:11.674509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3fc5-69eb-4cce-a04c-093d7392f513 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:11.674793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3fc5-69eb-4cce-a04c-093d7392f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:11.675115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf3fc5-69eb-4cce-a04c-093d7392f513 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:11.676013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3fc5-69eb-4cce-a04c-093d7392f513 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=829b4ad50f8441248c0b6d5259b89fa5) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:11.676382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3fc5-69eb-4cce-a04c-093d7392f513 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:11.678783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf3fc5-69eb-4cce-a04c-093d7392f513 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:11.686939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 272/539] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:11 2022] GET /identity/v3/role_assignments?user.id=829b4ad50f8441248c0b6d5259b89fa5&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:11.745192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 268/540] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:01:11 2022] POST /identity/v3/users => generated 247 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:13.139286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9281a-90df-4473-8595-2c17f5c46043 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.139805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9281a-90df-4473-8595-2c17f5c46043 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.139907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9281a-90df-4473-8595-2c17f5c46043 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.142782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 273/541] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:13.149344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1891bf-13b4-4888-8e8c-a89d07ff0931 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.150261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1891bf-13b4-4888-8e8c-a89d07ff0931 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.150733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1891bf-13b4-4888-8e8c-a89d07ff0931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.174511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6b1891bf-13b4-4888-8e8c-a89d07ff0931 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:13.176053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6b1891bf-13b4-4888-8e8c-a89d07ff0931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:13.188891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 269/542] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:13.238626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9281a-90df-4473-8595-2c17f5c46043 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.259634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9281a-90df-4473-8595-2c17f5c46043 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.270949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.271768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.272087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.272368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.294593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:13.301839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:13.307796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 274/543] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:13.310052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1891bf-13b4-4888-8e8c-a89d07ff0931 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.335509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1891bf-13b4-4888-8e8c-a89d07ff0931 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.350897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.360927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.360927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.360927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.360927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:13.360927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.360927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.375269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 270/544] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:13.380989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.396088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb84e8-a726-47e9-b6d3-6d370bb664f1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.405402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.406255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.406538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.406811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.429429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.431336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.460929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:13.467813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 275/545] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:13.469710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.496954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4044-c2c5-4a9c-87fd-4862a9927095 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.514459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.515153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.515437 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.515697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.516438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:13.516744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.518492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.533022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 271/546] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:13.538589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.550557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706a6b-48b8-4ac9-90ee-78d90facf2e5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.561018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.561860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.562140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.562417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.574963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.577021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.597478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:01:13.598738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 276/547] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:13.604765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.615672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cb3b0-2c6f-4811-955b-9398de1c7d36 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.625967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.626659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.626942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.627219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.628064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:13.628372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.630284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.653000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 272/548] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:13.658593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.671659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0079d3c-7f17-48d2-b41e-8c4004fd3613 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.676484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.678120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.678613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.679105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.694051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.696417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.716907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:13.718795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 277/549] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:13.731448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.741673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aedd212-969a-4469-9e45-d02d89eb45bb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.750212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.750895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.751178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.751459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.752192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:13.752505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.754149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.775228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 273/550] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:13.781839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.796322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f85b3-c225-4e34-bfd3-720c7b8a7646 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.806796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.807978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.808262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.808617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.821248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.823260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.845881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:13.847306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 278/551] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:13.853636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.865431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fe8a-028a-4f92-8059-ba8019f3f7a9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.875497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8aae1-efbf-4db0-9a62-c4c1710165f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.876172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8aae1-efbf-4db0-9a62-c4c1710165f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.876455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8aae1-efbf-4db0-9a62-c4c1710165f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.876733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8aae1-efbf-4db0-9a62-c4c1710165f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.877551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8aae1-efbf-4db0-9a62-c4c1710165f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:13.877859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8aae1-efbf-4db0-9a62-c4c1710165f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.879726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8aae1-efbf-4db0-9a62-c4c1710165f0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:13.895133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 274/552] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:13.900828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:13.918877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae6c7d-f390-4933-9b71-92bca4a3ef79 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:13.926801 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5995632-8bb6-43e9-8200-01a6d1883fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:13.928044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5995632-8bb6-43e9-8200-01a6d1883fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:13.928330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5995632-8bb6-43e9-8200-01a6d1883fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:13.928605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5995632-8bb6-43e9-8200-01a6d1883fd1 admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/28dfb9c84dda4d6799a490a009e867df/roles/103afb794083469bba2437eec01fd04b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:13.949663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5995632-8bb6-43e9-8200-01a6d1883fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=28dfb9c84dda4d6799a490a009e867df, role_id=103afb794083469bba2437eec01fd04b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:13.952451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5995632-8bb6-43e9-8200-01a6d1883fd1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.047761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 279/553] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:13 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/28dfb9c84dda4d6799a490a009e867df/roles/103afb794083469bba2437eec01fd04b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:14.338174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590a7c2-cf9d-4758-ada0-12e9c7dd2e5a None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.338174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590a7c2-cf9d-4758-ada0-12e9c7dd2e5a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.338174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590a7c2-cf9d-4758-ada0-12e9c7dd2e5a None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.338174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 275/554] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:14.347263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3b58-d213-4bf0-b63a-eef340d4a05d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.347263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3b58-d213-4bf0-b63a-eef340d4a05d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.347263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3b58-d213-4bf0-b63a-eef340d4a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.372438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1dea3b58-d213-4bf0-b63a-eef340d4a05d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:14.373708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1dea3b58-d213-4bf0-b63a-eef340d4a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:14.455413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 280/555] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:14.497618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590a7c2-cf9d-4758-ada0-12e9c7dd2e5a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.515683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590a7c2-cf9d-4758-ada0-12e9c7dd2e5a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.522607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.523415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.523694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.523967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.544215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:14.556291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:14.557595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 276/556] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:14.565702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea3b58-d213-4bf0-b63a-eef340d4a05d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.581683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea3b58-d213-4bf0-b63a-eef340d4a05d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.587716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4226-6f20-45f2-a1c5-65b4687fb61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.588396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4226-6f20-45f2-a1c5-65b4687fb61c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.588674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4226-6f20-45f2-a1c5-65b4687fb61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.588949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4226-6f20-45f2-a1c5-65b4687fb61c admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.589865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e4226-6f20-45f2-a1c5-65b4687fb61c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:14.590747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e4226-6f20-45f2-a1c5-65b4687fb61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:14.592395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e4226-6f20-45f2-a1c5-65b4687fb61c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.606059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 281/557] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:14.611961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.627722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e00c0-3fb6-4f19-a9c4-1325a5013293 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.631499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49044-d5ea-4b6e-af30-79ac302cace8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.631790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49044-d5ea-4b6e-af30-79ac302cace8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.632048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d49044-d5ea-4b6e-af30-79ac302cace8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.633865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 282/558] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:14.641722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.642155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807993e7-0c34-4c88-b7cf-351ce20244a9 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.642397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807993e7-0c34-4c88-b7cf-351ce20244a9 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.642616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.642826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807993e7-0c34-4c88-b7cf-351ce20244a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.643054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.643054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.667083 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:14.669255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.675232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-807993e7-0c34-4c88-b7cf-351ce20244a9 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:14.676419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-807993e7-0c34-4c88-b7cf-351ce20244a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:14.695225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:14.696682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 277/559] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:14.702649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 283/560] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:14.718472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.726241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807993e7-0c34-4c88-b7cf-351ce20244a9 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.738327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa5eb6-884a-4255-a171-70ee59e9551e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.746800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807993e7-0c34-4c88-b7cf-351ce20244a9 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.758852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a6ed2-4d10-4a91-980c-eb15e9f18374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.759213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.760438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.762594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a6ed2-4d10-4a91-980c-eb15e9f18374 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.763261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.763839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.765284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:14.765856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a6ed2-4d10-4a91-980c-eb15e9f18374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.766446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a6ed2-4d10-4a91-980c-eb15e9f18374 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.767333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:14.771151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.787517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 278/561] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:14.793408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.804578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eed133-538a-498a-92bd-66893676d6d1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.810121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a6ed2-4d10-4a91-980c-eb15e9f18374 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:14.815411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dfdcf-861a-4fca-8b78-660a996556a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.816265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dfdcf-861a-4fca-8b78-660a996556a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.816550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dfdcf-861a-4fca-8b78-660a996556a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.816823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dfdcf-861a-4fca-8b78-660a996556a4 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.821351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-c46a6ed2-4d10-4a91-980c-eb15e9f18374 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:14.822924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 284/562] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:14.824834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f12e-9fd5-472a-bc26-0e36d3fe8677 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.825166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f12e-9fd5-472a-bc26-0e36d3fe8677 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.825445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f12e-9fd5-472a-bc26-0e36d3fe8677 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.830783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dfdcf-861a-4fca-8b78-660a996556a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:14.831578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 285/563] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:14.832470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f12e-9fd5-472a-bc26-0e36d3fe8677 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.833010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dfdcf-861a-4fca-8b78-660a996556a4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.845603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f12e-9fd5-472a-bc26-0e36d3fe8677 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.850390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.850834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-d18dfdcf-861a-4fca-8b78-660a996556a4 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 18:01:14.851103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.851446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.851724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.852341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 279/564] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:14.852597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:14.852911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:14.854749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.858845 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc41a70-931a-4dcb-ab3f-d6011961a32c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.859560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc41a70-931a-4dcb-ab3f-d6011961a32c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.859844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc41a70-931a-4dcb-ab3f-d6011961a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.866881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 286/565] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:14.867603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.883585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5b348-e07f-4e21-8c59-dfb83c033fe5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.889208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0dc41a70-931a-4dcb-ab3f-d6011961a32c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:14.890551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0dc41a70-931a-4dcb-ab3f-d6011961a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:14.892037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.893107 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.893665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.894148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.895370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:14.895929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:14.898198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.903594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 280/566] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:14.903594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc41a70-931a-4dcb-ab3f-d6011961a32c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.918506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc41a70-931a-4dcb-ab3f-d6011961a32c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.932614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.934465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.934981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.935455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.936817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 287/567] 10.222.0.87 () {56 vars in 1158 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:14.937807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.948889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:14.950741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438530d-67c5-436a-a914-2ab5ba5fc721 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.952225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:14.955946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:14.956813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:14.957163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:14.957449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:14.971372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:14.974645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:14.976430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 281/568] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:14.977569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.980843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:14.986918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 288/569] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:14.986918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:14.998139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0921c-a989-4468-af8f-f5658c8bb457 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:14.999182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e804a6-25a3-4294-b8b6-9c6ee53f0ccb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.003846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.004333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.005066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.005289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.005681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.005831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.006126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.006407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.007164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.007570 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.009309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.021226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.023620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.024060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 289/570] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.025104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.035490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae099ff-f97c-4cb6-8327-e369bbd3300e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.040389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.041215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.041607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.042015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.043597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.044634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.046509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.047024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:15.049430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 282/571] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.053249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.061455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 290/572] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.063712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.067975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28eafc-3608-46c9-994b-59cc501bd265 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.072843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.073843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.074268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.074771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.081501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94559-6fe8-482d-a1fa-df8243ed2cb3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.083987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.086305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.087074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.087956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.088385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.089054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.090660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.091129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.092917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.104673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 18:01:15.107034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 291/573] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.107525 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 283/574] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.108446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.115253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.127064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf651b7-9a85-4b84-a83d-f57a1455e270 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.128712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941e23-bf2d-4f4d-8df2-8ab95931a788 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.131714 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.132381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.132662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.132934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.133805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.134114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.135926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.136762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.138264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.138669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.139943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.158963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.161059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.161342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 284/575] 10.222.0.87 () {56 vars in 1160 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:15.162288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.173512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecfc74-f075-4b63-bdae-814d6fe48ed7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.178324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.179124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.179402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.179678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.183277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:15.185406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 292/576] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.189966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.191732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.195532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.210739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f36ff-7101-4ef9-ab51-34021de0e342 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.215257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:15.215692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.216554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.216840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.217156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.220929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 285/577] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.222135 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.235466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae1d68-c3e5-486e-9b77-b6939b664c76 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.240341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.240776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.241755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.242245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.242352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.243058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.244076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.244589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.247169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.261126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:15.261633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 286/578] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.263089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 293/579] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.267359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.268639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.278877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a250-6a04-4af1-bf45-b0ab3be3daa3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.279325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d7e42-0e20-40c4-8e20-8f6ed721e2de admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.284061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.284763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.285235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.285687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.285800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.286172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.286351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.286718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.287386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.287742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.287986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.288242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.289922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.290381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.309468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 294/580] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:15.310838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.311647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 287/581] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.316584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.324130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf341c-8e62-48ad-8d65-1d005c94c741 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.327598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be994c3-21a7-4de3-8bfa-30c22dfa1932 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.329683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.330820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.331213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.331630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.333833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.334989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.335504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.335961 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.343285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.345478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.347728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.350763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.366371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:15.373266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 18:01:15.373404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 288/582] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.373404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.374367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 295/583] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.380730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.387838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e18215-abf7-4881-a4bc-56d06dc2178f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.394997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.395849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0be082-1b69-47b1-ab01-6ff53813f728 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.397346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.398361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.398968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/715e34300eef47d9aa2839cb3c5c5fae/roles/103afb794083469bba2437eec01fd04b` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.401486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.402993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.403503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.403828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.405879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.405879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.407163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.425192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 296/584] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.427298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=715e34300eef47d9aa2839cb3c5c5fae, role_id=103afb794083469bba2437eec01fd04b)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.428484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.432317 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.441060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e75b5-6c1b-412a-81f9-9794197221fd admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.445621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.451055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.451055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.451055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.451055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.451055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.451055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.473940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 297/585] 10.222.0.87 () {56 vars in 1158 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.473940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.484212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923dbe-c937-41a9-91a8-6446d2fc9999 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.490006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.490889 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.491251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.491496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/9b842d30b55c48bf8f375bdcc829bf57/roles/103afb794083469bba2437eec01fd04b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.508632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=9b842d30b55c48bf8f375bdcc829bf57, role_id=103afb794083469bba2437eec01fd04b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.511511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.514734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 289/586] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:15 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/715e34300eef47d9aa2839cb3c5c5fae/roles/103afb794083469bba2437eec01fd04b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:15.514734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.610704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 298/587] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:15 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/9b842d30b55c48bf8f375bdcc829bf57/roles/103afb794083469bba2437eec01fd04b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:15.618844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322905-f505-4d70-a790-5c0bcf860add admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.757780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.758851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.759349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.759792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.778695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.780574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.800000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:15.801516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 290/588] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.808146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.819026 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b7c7c-c007-4c8c-a838-d451a4849a5b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.826011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c273c4-b97d-4e6e-aa77-0e5636096290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.826699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c273c4-b97d-4e6e-aa77-0e5636096290 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.826984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c273c4-b97d-4e6e-aa77-0e5636096290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.827258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c273c4-b97d-4e6e-aa77-0e5636096290 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.827996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c273c4-b97d-4e6e-aa77-0e5636096290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.828300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c273c4-b97d-4e6e-aa77-0e5636096290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.829979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c273c4-b97d-4e6e-aa77-0e5636096290 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.845505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 299/589] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:15.851286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.862170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa645a9-b839-4ca0-9690-30c657ab7e5c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.870608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.871478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.871766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.872046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.881348 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.883434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.895468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bf1f7-bfc1-4ad5-b27e-c7051a1ca448 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.895935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bf1f7-bfc1-4ad5-b27e-c7051a1ca448 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.896386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bf1f7-bfc1-4ad5-b27e-c7051a1ca448 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.899717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 300/590] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:15.905486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:15.906943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 291/591] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:15.908511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da766f-0a8a-43c4-88ce-08851ef191b5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.908973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da766f-0a8a-43c4-88ce-08851ef191b5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.909453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da766f-0a8a-43c4-88ce-08851ef191b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.913501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.926045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dbcf3-9ed0-4d19-97a7-3ce254e919c4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.931673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.932734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.933242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.934401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.935585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:15.936324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:15.938825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:15.958761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 292/592] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:15.962082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:15.970692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-44da766f-0a8a-43c4-88ce-08851ef191b5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:15.972567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-44da766f-0a8a-43c4-88ce-08851ef191b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:15.974473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a9bfe-d767-4401-a3ef-01e03554cf14 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:15.979415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:15.980952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:15.981588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:15.982075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/829b4ad50f8441248c0b6d5259b89fa5/roles/103afb794083469bba2437eec01fd04b` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:15.997108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 301/593] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:16.007072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=829b4ad50f8441248c0b6d5259b89fa5, role_id=103afb794083469bba2437eec01fd04b)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.012964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.022757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da766f-0a8a-43c4-88ce-08851ef191b5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.039864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da766f-0a8a-43c4-88ce-08851ef191b5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.047603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.048962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.049466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.049929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.069642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:16.084103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:16.086670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 302/594] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:16.099298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 293/595] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:15 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/829b4ad50f8441248c0b6d5259b89fa5/roles/103afb794083469bba2437eec01fd04b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:01:16.100316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.112548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163af00-ad49-4cb9-a3bd-d1d8f9547f4e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.180905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.181672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.181962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.182245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.183012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:16.183327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.186282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.201071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 303/596] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:16.206984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.219214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a907b09-66e3-4692-b6df-78244e287b85 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.230010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.231169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.231647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.231992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.249020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.250984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.279631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:16.281182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 294/597] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:16.291228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.311711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf363-243b-4556-9cdb-9d02375b34a2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.326046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.326779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.327217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.327505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.328270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:16.328581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.330362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.347713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 304/598] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:16.353659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.365658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36fd85-7e76-49f4-b659-75b252dd1846 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.377839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.378666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.379022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.379311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.390498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.392642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.409272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 18:01:16.414209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 295/599] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:16.417185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.431472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1c6fe-52f7-42fc-be8e-d3b0a77a7555 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.437040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.438092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.438584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.439064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.442725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:16.443350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.445462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.472855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 305/600] 10.222.0.87 () {56 vars in 1156 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:16.475235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.498546 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf135e-351e-4814-9e9b-4f6a15de0d3f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.507601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.508859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.509406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.509916 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.526734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.530332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.552558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 296/601] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:01:16.559126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.579304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893e49-5e40-4e72-b51b-e4e002ad1865 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.589768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.591266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.591851 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.592138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.613354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.615316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.645226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:16.646795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 306/602] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:16.653008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.667915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea08ff-e143-4d4b-8eda-76c410bcb516 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.672968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.673895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.674423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.681115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.682249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:16.682777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.684913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.703420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 297/603] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:16.709191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.725251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cca52-c341-4deb-8c59-6390be3bc9e0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.734628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.735506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.735798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.736134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.748167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.750383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.771419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:16.772959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 307/604] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:16.779407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.794579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688cc40-894c-4be2-8e00-c711b7dec3b8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.799563 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edaedc-0502-4470-b763-0f4086dbb922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.800552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edaedc-0502-4470-b763-0f4086dbb922 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.801171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edaedc-0502-4470-b763-0f4086dbb922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.801647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edaedc-0502-4470-b763-0f4086dbb922 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.802890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edaedc-0502-4470-b763-0f4086dbb922 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:16.803398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edaedc-0502-4470-b763-0f4086dbb922 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.813744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edaedc-0502-4470-b763-0f4086dbb922 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.832049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 298/605] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:16.838074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:16.855034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b8ef6-3938-443f-91e0-6f1264976ea2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:16.865867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be78c3-485f-42a4-adeb-848eab401fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:16.866657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be78c3-485f-42a4-adeb-848eab401fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:16.866920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be78c3-485f-42a4-adeb-848eab401fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:16.867200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be78c3-485f-42a4-adeb-848eab401fc4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:16.868103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be78c3-485f-42a4-adeb-848eab401fc4 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=9450573df8c6430a8271e86f15954d6c) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:16.868418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be78c3-485f-42a4-adeb-848eab401fc4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:16.870479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be78c3-485f-42a4-adeb-848eab401fc4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:16.881834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 308/606] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:16 2022] GET /identity/v3/role_assignments?user.id=9450573df8c6430a8271e86f15954d6c&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:17.178257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184dc0-8efa-42f1-b2b8-d45af5fa764e None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.178758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184dc0-8efa-42f1-b2b8-d45af5fa764e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.179193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184dc0-8efa-42f1-b2b8-d45af5fa764e None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.181015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 299/607] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:17.196449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450ee0-886b-44cd-8b94-1a0fd8d06551 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.196865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450ee0-886b-44cd-8b94-1a0fd8d06551 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.197737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450ee0-886b-44cd-8b94-1a0fd8d06551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.226153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-dd450ee0-886b-44cd-8b94-1a0fd8d06551 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:17.227364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dd450ee0-886b-44cd-8b94-1a0fd8d06551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:17.241198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 309/608] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:17.295273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f184dc0-8efa-42f1-b2b8-d45af5fa764e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.318594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f184dc0-8efa-42f1-b2b8-d45af5fa764e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.331321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.332157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.332440 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.332713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.354280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:17.362441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:17.366600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 300/609] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:17.372738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd450ee0-886b-44cd-8b94-1a0fd8d06551 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.388642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd450ee0-886b-44cd-8b94-1a0fd8d06551 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.397212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.397899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.398179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.398451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.399200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:17.399499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.401206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.416092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 310/610] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:17.424571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.443036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05a919-ba26-4ad8-8b2a-3437a60ed764 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.457991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.459460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.460017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.460509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.492763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.498131 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.545029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:17.546635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 301/611] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:17.552786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.565583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ecba2-bd2f-465c-a3fd-15b7ba35c8ac admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.583712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.584401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.584684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.584957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.585722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:17.586028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.587648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.607346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 311/612] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:17.612688 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.639107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8c14-a035-4146-a875-e405d0626fff admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.648007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.649269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.649725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.650241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.668512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.671488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.688197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:01:17.690492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 302/613] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:17.697061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.711354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4761d180-c2e3-4042-a51e-49dd5711291d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.722044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.722908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.723188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.723504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.725020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:17.725566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.727910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.753928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 312/614] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:17.759929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.775967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ab66e-4021-46c4-bf57-661980413f42 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.783792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.784609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.785205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.785667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.801190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.803738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.819281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 303/615] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:17.826357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.843768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c0f61-2070-4339-8cd5-a8220847c9a6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.853439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.854347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.854632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.854911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.878106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.882303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.914849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:17.922398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 313/616] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:17.931612 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:17.946837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6009-3f24-4dc0-8fba-03a455e65457 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:17.952349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:17.953302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:17.953826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:17.954308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:17.961103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:17.961863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:17.963754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:17.987477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 304/617] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:17.992843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:18.008663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b508191-5ef0-406d-8a7b-e594f1775e30 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:18.020114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:18.020933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:18.021291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:18.021569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:18.037390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:18.039482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:18.064381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:18.065997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 314/618] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:18.072257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:18.087081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2477d3-e469-4059-9d75-73fac80d26aa admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:18.102857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027108-e56f-463b-85d6-3658a66b2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:18.103551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027108-e56f-463b-85d6-3658a66b2965 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:18.103828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027108-e56f-463b-85d6-3658a66b2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:18.104106 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027108-e56f-463b-85d6-3658a66b2965 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:18.104906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027108-e56f-463b-85d6-3658a66b2965 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:18.105244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027108-e56f-463b-85d6-3658a66b2965 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:18.108046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027108-e56f-463b-85d6-3658a66b2965 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:18.131445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 305/619] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:18.137973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:18.152956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc48c-3b05-476a-b186-ffccfef6c49b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:18.161679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3a9e4-edd4-4ffe-beac-ada4b1ef2c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:18.162768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3a9e4-edd4-4ffe-beac-ada4b1ef2c1d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:18.163322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3a9e4-edd4-4ffe-beac-ada4b1ef2c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:18.163794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3a9e4-edd4-4ffe-beac-ada4b1ef2c1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:18.164934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3a9e4-edd4-4ffe-beac-ada4b1ef2c1d admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=28dfb9c84dda4d6799a490a009e867df) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:18.165486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3a9e4-edd4-4ffe-beac-ada4b1ef2c1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:18.167631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3a9e4-edd4-4ffe-beac-ada4b1ef2c1d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:18.183048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 315/620] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:18 2022] GET /identity/v3/role_assignments?user.id=28dfb9c84dda4d6799a490a009e867df&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:18.919743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f421e1-aa22-4f76-901b-ff9a92756f08 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:18.920266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f421e1-aa22-4f76-901b-ff9a92756f08 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:18.920266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f421e1-aa22-4f76-901b-ff9a92756f08 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:18.922579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 306/621] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:18.929407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf05c-91f8-4343-988a-ca40eb47be68 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:18.929905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf05c-91f8-4343-988a-ca40eb47be68 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:18.930009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bf05c-91f8-4343-988a-ca40eb47be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:18.956072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-714bf05c-91f8-4343-988a-ca40eb47be68 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:18.958170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-714bf05c-91f8-4343-988a-ca40eb47be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:18.967109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 316/622] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:18.993304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f421e1-aa22-4f76-901b-ff9a92756f08 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.009429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f421e1-aa22-4f76-901b-ff9a92756f08 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.016203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.017463 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.017952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.018424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.021618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5610c-03c4-43d3-84ca-41f7f1ad2fff None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.021909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5610c-03c4-43d3-84ca-41f7f1ad2fff None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.022365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5610c-03c4-43d3-84ca-41f7f1ad2fff None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.024163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 317/623] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:19.034960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6127-0265-4916-bdbd-2bc503e3864c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.035281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6127-0265-4916-bdbd-2bc503e3864c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.035687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6127-0265-4916-bdbd-2bc503e3864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.037352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:19.044875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:19.046592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 307/624] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.055004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.063474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-062f6127-0265-4916-bdbd-2bc503e3864c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:19.065799 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-062f6127-0265-4916-bdbd-2bc503e3864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:19.070148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04004-2d40-4719-beca-2be7ed85d0cd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.075307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 318/625] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:19.081118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.081118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.081118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.081118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.081699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.081699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.081699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.090794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 308/626] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.096462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6127-0265-4916-bdbd-2bc503e3864c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.106310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.112636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6127-0265-4916-bdbd-2bc503e3864c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.117479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c5c3d-79f8-4264-bf2b-62470fe3d374 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.118705 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.119753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.120216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.120663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.123548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.124861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.125256 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.126022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.134572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.136780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.143189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:19.152923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:19.154848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 309/627] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:19.167236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.167766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:19.169638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 319/628] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.183264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99665aa8-f99c-47d4-a7b5-8e68b228f6ac admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.187219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.197369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.200226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.200226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.209304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.209304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.209304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.209304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.209852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b4588-f3ec-4fcf-ad79-d9ad6265261c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.218316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.218653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.218937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.219212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.221208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.225105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.226307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.228848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 310/629] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.242589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.263993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 320/630] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.264434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d555809-691d-47e7-b7f4-a33a56954d90 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.269613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.282628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388e992-7360-4118-a67a-99aee09513a9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.284857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238b2aa-4957-4739-829c-0a2e4d9ccb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.285745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238b2aa-4957-4739-829c-0a2e4d9ccb95 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.286040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238b2aa-4957-4739-829c-0a2e4d9ccb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.286322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238b2aa-4957-4739-829c-0a2e4d9ccb95 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.301428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.302504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.302788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.303065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.305040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238b2aa-4957-4739-829c-0a2e4d9ccb95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.306953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238b2aa-4957-4739-829c-0a2e4d9ccb95 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.321338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.323400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.336646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-2238b2aa-4957-4739-829c-0a2e4d9ccb95 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:19.338400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 311/631] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:19.339143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 18:01:19.339883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51d2f-d52e-4ba7-bcb5-3a57649ae181 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.340338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51d2f-d52e-4ba7-bcb5-3a57649ae181 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.340797 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a51d2f-d52e-4ba7-bcb5-3a57649ae181 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.341777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 321/632] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.343136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 312/633] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:19.348629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.367863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099744-eee8-454b-8c56-26e158feb265 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.367863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099744-eee8-454b-8c56-26e158feb265 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.367863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099744-eee8-454b-8c56-26e158feb265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.368404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc36f62-b5c7-4f6b-82f9-0c3f66dc8f0c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.368404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.368404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.368404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.368901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.368901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.368901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.368901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.372860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-86099744-eee8-454b-8c56-26e158feb265 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:19.374278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-86099744-eee8-454b-8c56-26e158feb265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:19.383229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 322/634] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.384101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.384731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 313/635] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:19.393930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86099744-eee8-454b-8c56-26e158feb265 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.403803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86099744-eee8-454b-8c56-26e158feb265 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.406452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d09f4-9484-452e-95dc-6785279011da admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.409903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.410980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.411412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.411831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.417840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.418542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.418827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.419156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.420060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.420374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.422312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.423637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.426908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.445843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 18:01:19.447612 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 314/636] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.448604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.465356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93508fab-5086-42eb-a3e0-b22083159a60 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.467557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 323/637] 10.222.0.87 () {56 vars in 1158 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.468811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.470984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.472000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.472452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.472913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.482006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdfa13-260b-43de-bd45-d58f2a92b04d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.485344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:19.486978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.487920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.488322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.488667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.489649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.490080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.492146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.493920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:19.495652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 315/638] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.497334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.515339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef74c9-ef4a-4952-8a28-3b17bfc67986 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.520596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.521551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.521985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.522754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.533182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 324/639] 10.222.0.87 () {56 vars in 1160 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.534796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.538093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.540014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.549648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54788c-89e1-48a6-826e-a0e5bae1305b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.552030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 316/640] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:19.553271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.555829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.556848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.557651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.558081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.561463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.562232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.566037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.568178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d4315-5d78-4d0f-a1fa-e0ee03547a36 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.573866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.575389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.575792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.576169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.580735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 325/641] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.581868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.597069 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.600500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.600796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be692460-df48-4c24-9c84-1f856a6d83b0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.606477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.607502 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.608001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.608429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.621219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 317/642] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:19.622765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.631051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.635471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.639371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db159-4fef-4ad6-9696-526f9f2e551e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.648523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.650823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.651413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.651967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.660398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:19.662484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 326/643] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.663630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.675226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.677369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.677677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9d30-9024-4b80-acf0-5dfb1d42276f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.683852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.685061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.685686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.685975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.700888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:19.701630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.702703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 318/644] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.703575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.704304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.718029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ded889-72d2-4c56-91a8-2bad70a66eff admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.724006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.724705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.724995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.725309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.726063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.726378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.728188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.732896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:19.734503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 327/645] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.735576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.742662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 319/646] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.746173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.756748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d57f4-c680-4ba0-a7d4-b4960e8831dc admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.762388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.763347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.763481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e85175-6f20-474c-a326-ea30c0f81379 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.764000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.764539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.765517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.765902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.767820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.769339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.771035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.771519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.772166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.773175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.773665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.776183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.782981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 328/647] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.784036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.794056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 320/648] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.794863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618c79-c6ef-4157-afaf-06651ea2be43 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.795463 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.800025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.801211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.801574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.801932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.808378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b5fd-9ee3-4194-90cd-66338715f64f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.811396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.813430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.818066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.819265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.819871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.820372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.830210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.830389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:19.831797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 329/649] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.836847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.836993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.846838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab65c0-3227-43e4-9b04-358c5f56fc0e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.852559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aad96-005e-456f-825e-c285f710683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.853406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aad96-005e-456f-825e-c285f710683f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.853696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aad96-005e-456f-825e-c285f710683f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.854018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aad96-005e-456f-825e-c285f710683f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.858964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 18:01:19.860523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 321/650] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.861755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.862867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aad96-005e-456f-825e-c285f710683f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.869127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aad96-005e-456f-825e-c285f710683f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.883029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66e32-6acc-49d4-833e-20ee7fb4ede7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.886597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-567aad96-005e-456f-825e-c285f710683f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:19.888653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 330/651] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:19.889677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aad96-005e-456f-825e-c285f710683f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.899513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.900556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.901018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.901482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.902557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aad96-005e-456f-825e-c285f710683f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.902798 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.903807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.907259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.908913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.909839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.910326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.910764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.911913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.912371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.914601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.932314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 322/652] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.935281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.937907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 331/653] 10.222.0.87 () {56 vars in 1158 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.939388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.953020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd24133-9d4b-40b8-9b4a-cb3d80219932 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.957813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.958481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.958830 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.959111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.959950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=715e34300eef47d9aa2839cb3c5c5fae) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.960263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.960469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cec00-cf19-4e30-9470-21090de95229 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.962451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.968306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.969603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.970045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.970504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.971516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 332/654] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/role_assignments?user.id=715e34300eef47d9aa2839cb3c5c5fae&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:19.971673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:19.972138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:19.972451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:19.974469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:19.984798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0999b6-c61d-4393-b66b-b93caaba5904 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:19.989783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:19.990445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:19.990756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:19.991011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:19.999321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 323/655] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.003245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.005155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.007044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.023613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1092ae8-1730-4148-87a1-d6412e7208bb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.030342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 333/656] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:20.033850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.034542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.034832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.035108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.035964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=9b842d30b55c48bf8f375bdcc829bf57) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.036273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.038146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.044376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.054643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6ead-d942-402d-b465-9d8b52f74a6e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.057524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 324/657] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/role_assignments?user.id=9b842d30b55c48bf8f375bdcc829bf57&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.062933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.063839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.064123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.064403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.087850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.091235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.123474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:20.124783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 334/658] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:20.130895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.157394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504742dc-c7d5-4bf0-91b6-677804ce4eba admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.167991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fac01-db75-41ba-a3b9-e0132bdc309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.169003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fac01-db75-41ba-a3b9-e0132bdc309f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.169003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fac01-db75-41ba-a3b9-e0132bdc309f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.169276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fac01-db75-41ba-a3b9-e0132bdc309f admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.170179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fac01-db75-41ba-a3b9-e0132bdc309f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.170492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fac01-db75-41ba-a3b9-e0132bdc309f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.172319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fac01-db75-41ba-a3b9-e0132bdc309f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.202293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 325/659] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.208364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.228125 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dd5a3-b6b0-4985-b937-095145596715 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.238797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.239819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.240250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.240640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.250771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.252461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279058d-054f-476d-9842-c63c97f011f3 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.252755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279058d-054f-476d-9842-c63c97f011f3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.253039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279058d-054f-476d-9842-c63c97f011f3 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.253622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.255324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 326/660] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:20.261631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebfca0-7b12-4714-8042-8599c46d03b1 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.262385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebfca0-7b12-4714-8042-8599c46d03b1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.263176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebfca0-7b12-4714-8042-8599c46d03b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.274899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:20.276710 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 335/661] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:20.283568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.297309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-05ebfca0-7b12-4714-8042-8599c46d03b1 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:20.297309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-05ebfca0-7b12-4714-8042-8599c46d03b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:20.301252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc530b7-7a47-44c1-bbf1-37c1cc0e2f05 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.311567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.312256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.312544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.312825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.314518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.314661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.318135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.318335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 327/662] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 16 18:01:20.337066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 336/663] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.338592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebfca0-7b12-4714-8042-8599c46d03b1 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.348934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.353473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebfca0-7b12-4714-8042-8599c46d03b1 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.359971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.361269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.361269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.361470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.362298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=829b4ad50f8441248c0b6d5259b89fa5) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.362608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.364482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.365289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f781d-ee05-467b-bb94-896138928f6d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.370663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.372546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.373201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.373670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.379175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 328/664] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/role_assignments?user.id=829b4ad50f8441248c0b6d5259b89fa5&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.389336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:20.397262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:20.399229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 337/665] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:20.408025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.427428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c292-e2ab-40b4-b58b-1092271029ea admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.432168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.432870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.433267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.433624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.434456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.434821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.436793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.447581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 329/666] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.453941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.466475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049f841-4da1-4e1d-bb35-41968a1fbb19 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.471422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.472257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.472546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.472826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.486727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.488777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.519246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:20.521765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 338/667] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:20.529255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.540920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019179-971c-4ad5-bd6c-cff33d7b20b9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.546515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.547229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.547517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.547872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.548657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.548945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.550973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.568465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 330/668] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.575222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.590457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d4042-dca3-4bbc-9adc-8ed7ae7500a9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.598453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.599871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.600311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.600750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.611488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.613769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.631205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 18:01:20.632923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 339/669] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:20.640593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.655507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27443215-74e0-487b-847b-7e969debe56f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.661763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.662724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.663164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.663611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.664605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.665065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.667098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.692825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 331/670] 10.222.0.87 () {56 vars in 1156 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.698083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.709321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aecc11-0f6f-4808-8f8b-72702370502e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.716110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.717393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.717632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.717913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.731576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.734856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.757458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:20.759091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 340/671] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:20.765580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.775874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e090-0dab-4530-b840-1381af4609dc admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.781404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.782104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.782447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.782733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.783479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.783843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.785759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.800175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 332/672] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.806202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.818046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37357f-6dc7-4684-bdb4-3077e70230c6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.823129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.824102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.824993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.825317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.834126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.836193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.851690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:20.857345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 341/673] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:20.859588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.870029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d863e-85eb-40d7-8da9-9b2984804ec5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.875737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee840af-84c3-4d0d-bfa2-ed1c2abbc698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.876478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee840af-84c3-4d0d-bfa2-ed1c2abbc698 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.876769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee840af-84c3-4d0d-bfa2-ed1c2abbc698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.877053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee840af-84c3-4d0d-bfa2-ed1c2abbc698 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.877942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee840af-84c3-4d0d-bfa2-ed1c2abbc698 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:20.878329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee840af-84c3-4d0d-bfa2-ed1c2abbc698 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.880313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee840af-84c3-4d0d-bfa2-ed1c2abbc698 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:20.896645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 333/674] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:20.906180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:20.924422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364a68e-dabb-4bbe-93b5-c1e31800bee7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:20.930571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4f974-0cc5-457b-935c-fb2d25138501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:20.932086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4f974-0cc5-457b-935c-fb2d25138501 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:20.932634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4f974-0cc5-457b-935c-fb2d25138501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:20.933106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4f974-0cc5-457b-935c-fb2d25138501 admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/9450573df8c6430a8271e86f15954d6c/roles/103afb794083469bba2437eec01fd04b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:20.958925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4f974-0cc5-457b-935c-fb2d25138501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=9450573df8c6430a8271e86f15954d6c, role_id=103afb794083469bba2437eec01fd04b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:20.964299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4f974-0cc5-457b-935c-fb2d25138501 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:21.054222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 342/675] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:20 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/9450573df8c6430a8271e86f15954d6c/roles/103afb794083469bba2437eec01fd04b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:21.669656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee314c8-719a-41ac-996a-37f39f74a609 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:21.670378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee314c8-719a-41ac-996a-37f39f74a609 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:21.670378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee314c8-719a-41ac-996a-37f39f74a609 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:21.672273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 334/676] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:21.678302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e957dd-912c-4c69-b1ac-ffcb5b2ac6a9 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:21.678591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e957dd-912c-4c69-b1ac-ffcb5b2ac6a9 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:21.678869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e957dd-912c-4c69-b1ac-ffcb5b2ac6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:21.698682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b0e957dd-912c-4c69-b1ac-ffcb5b2ac6a9 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:21.700617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b0e957dd-912c-4c69-b1ac-ffcb5b2ac6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:21.804190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 343/677] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 18:01:21.856964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee314c8-719a-41ac-996a-37f39f74a609 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:21.877002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee314c8-719a-41ac-996a-37f39f74a609 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:21.885167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:21.885984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:21.886295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:21.886605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:21.905935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:21.913860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:01:21.915254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 335/678] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:21.923065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e957dd-912c-4c69-b1ac-ffcb5b2ac6a9 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:21.941112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e957dd-912c-4c69-b1ac-ffcb5b2ac6a9 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:21.951677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:21.952780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:21.953471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:21.953812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:21.954719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:21.955029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:21.956806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:21.974132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 344/679] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:21.982532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.001002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85077c4a-2544-4e9e-837d-8f6f30681f2a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.009611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.010436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.010724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.011009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.029734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.031618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.052818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:22.054100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 336/680] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:22.060661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.074757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7116d-b717-482a-8bc8-4ac5491ef4fd admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.082834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.083842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.084330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.084772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.086036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:22.086556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.089315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.111989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 345/681] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:22.118647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.135128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd8dbf-6345-4328-a981-157d528e004e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.140150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.140980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.141313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.141592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.150984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.153790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.176422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:01:22.178286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 337/682] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:22.186336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.201202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3987fb-2d3d-4640-ac15-9943c00c51ab admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.205804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.206493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.206820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.207092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.208068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:22.208382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.210398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.244077 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 346/683] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:22.250208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.269991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d467119-3e70-4b92-84a7-8505723e704a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.278682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.279535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.279819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.280149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.293305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.295278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.307149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 338/684] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:01:22.314154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.325873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce5561-4962-42ba-9a42-504b07958914 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.333444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.334321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.334605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.334881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.350367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.352281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.376739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:22.378364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 347/685] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:22.385239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.407821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd469f-4e3a-4bfd-80b7-860a184b5c2e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.416447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.417157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.417443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.417719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.418499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:22.418807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.420448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.439458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 339/686] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:22.445169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.457432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2549357-b4a6-4fdf-bbef-2cd77ac27415 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.466613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.467547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.467830 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.468109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.479324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.482553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.512220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:22.513660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 348/687] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:22.519682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.531030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c98dfa-9750-4a5f-bb93-c090d350af79 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.541670 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654246b-1e3f-434f-a5bf-2ce27ae27903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.542417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654246b-1e3f-434f-a5bf-2ce27ae27903 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.542700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654246b-1e3f-434f-a5bf-2ce27ae27903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.543671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654246b-1e3f-434f-a5bf-2ce27ae27903 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.544515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654246b-1e3f-434f-a5bf-2ce27ae27903 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:22.544985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654246b-1e3f-434f-a5bf-2ce27ae27903 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.546996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654246b-1e3f-434f-a5bf-2ce27ae27903 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.573833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 340/688] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:22.581781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:22.601744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ef87-8ded-479a-8d70-d8b4a841da5d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:22.611273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461eec-af1d-4761-87c2-a10cc775968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:22.612000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461eec-af1d-4761-87c2-a10cc775968e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:22.612285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461eec-af1d-4761-87c2-a10cc775968e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:22.612611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461eec-af1d-4761-87c2-a10cc775968e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:22.613531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461eec-af1d-4761-87c2-a10cc775968e admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=578059b701674f41b39442d2a018b489, user.id=28dfb9c84dda4d6799a490a009e867df) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:22.613839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461eec-af1d-4761-87c2-a10cc775968e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:22.615877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461eec-af1d-4761-87c2-a10cc775968e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:22.625197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 349/689] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:22 2022] GET /identity/v3/role_assignments?user.id=28dfb9c84dda4d6799a490a009e867df&scope.project.id=578059b701674f41b39442d2a018b489&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:23.127416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb971-d3e3-4a01-be53-896a6855d94b None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.127416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb971-d3e3-4a01-be53-896a6855d94b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.127416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb971-d3e3-4a01-be53-896a6855d94b None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.127416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 341/690] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:23.134887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72171-7bc4-40d6-9cc1-d976c2c78561 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.135525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72171-7bc4-40d6-9cc1-d976c2c78561 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.135525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72171-7bc4-40d6-9cc1-d976c2c78561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.161494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e1e72171-7bc4-40d6-9cc1-d976c2c78561 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:23.162738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e1e72171-7bc4-40d6-9cc1-d976c2c78561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:23.176848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 350/691] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:23.209190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb971-d3e3-4a01-be53-896a6855d94b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:23.227901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb971-d3e3-4a01-be53-896a6855d94b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:23.234301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:23.235528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.236054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.236548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.250113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:23.252445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:23.272322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:23.274952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 342/692] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:23.282424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e72171-7bc4-40d6-9cc1-d976c2c78561 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:23.292330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e72171-7bc4-40d6-9cc1-d976c2c78561 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:23.298582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521661fa-fd88-43ed-b02d-1ee15112aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:23.299639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521661fa-fd88-43ed-b02d-1ee15112aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.300142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521661fa-fd88-43ed-b02d-1ee15112aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.300636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521661fa-fd88-43ed-b02d-1ee15112aa89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.301772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521661fa-fd88-43ed-b02d-1ee15112aa89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:23.302640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521661fa-fd88-43ed-b02d-1ee15112aa89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:23.304619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521661fa-fd88-43ed-b02d-1ee15112aa89 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:23.320091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 351/693] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:23.326369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:23.338267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62110f35-0fd7-42d5-ac60-2eeb121e766e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:23.343838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b71ad-79b3-426e-9e41-ad3e092aefe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:23.345049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b71ad-79b3-426e-9e41-ad3e092aefe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.345615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b71ad-79b3-426e-9e41-ad3e092aefe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.346110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b71ad-79b3-426e-9e41-ad3e092aefe7 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.347083 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b71ad-79b3-426e-9e41-ad3e092aefe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:23.349397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b71ad-79b3-426e-9e41-ad3e092aefe7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:23.450835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 343/694] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:01:23 2022] POST /identity/v3/users => generated 254 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:23.603155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e20ac-ae53-4370-b020-c75096ff2a38 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.603863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e20ac-ae53-4370-b020-c75096ff2a38 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.604415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e20ac-ae53-4370-b020-c75096ff2a38 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.608233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 352/695] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:23.614811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19454-933a-4687-b2fe-33d1d81fd7c6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.615471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19454-933a-4687-b2fe-33d1d81fd7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.615973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb19454-933a-4687-b2fe-33d1d81fd7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.641889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-3eb19454-933a-4687-b2fe-33d1d81fd7c6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:23.643614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3eb19454-933a-4687-b2fe-33d1d81fd7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:23.653176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 344/696] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:23.691950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e20ac-ae53-4370-b020-c75096ff2a38 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:23.711757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e20ac-ae53-4370-b020-c75096ff2a38 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:23.716956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:23.718185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.718697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.719179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] PATH_INFO: `/v3/services/network` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.720059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:23.721349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:23.721349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:01:23.721349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:01:23.722692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:23.741445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 18:01:23.743102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 353/697] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:23 2022] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:23.749954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb19454-933a-4687-b2fe-33d1d81fd7c6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:23.761073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb19454-933a-4687-b2fe-33d1d81fd7c6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:23.769276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:23.770398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.770877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.771353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.772650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:23.773212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:23.774939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:23.774939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:23.774939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:23.776008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a301bc-5d95-4253-8b29-323e7bf0dd42 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:23.782709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 345/698] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:23.788048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:23.800128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd4be-b82c-4017-a9ec-16cfa322d1fe admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:23.805812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:23.806484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.806768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.807099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.807815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] RBAC: Adding query filter params (type=network) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:23.808182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:23.810426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:23.810426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:01:23.810426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:01:23.812302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ee810-03f5-4192-80d0-1ff34c78a93a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:23.821960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 354/699] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:23.929206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a474-32e0-4419-ad1b-bb2595a81567 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.929605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a474-32e0-4419-ad1b-bb2595a81567 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.929825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244a474-32e0-4419-ad1b-bb2595a81567 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.932108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 346/700] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:23.939436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483f88-b753-4a1f-83c2-de63398a1ccb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:23.939745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483f88-b753-4a1f-83c2-de63398a1ccb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:23.940010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483f88-b753-4a1f-83c2-de63398a1ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:23.964453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d1483f88-b753-4a1f-83c2-de63398a1ccb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:23.965708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d1483f88-b753-4a1f-83c2-de63398a1ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:23.974896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 355/701] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:24.001436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a474-32e0-4419-ad1b-bb2595a81567 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:24.020156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244a474-32e0-4419-ad1b-bb2595a81567 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:24.024907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:24.025816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.026101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.026383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.027052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:24.028190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:24.028190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:24.028190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:24.029111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:24.046071 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 18:01:24.052069 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 347/702] 10.222.0.87 () {56 vars in 1150 bytes} [Wed Feb 16 18:01:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:24.053967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483f88-b753-4a1f-83c2-de63398a1ccb None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:24.071633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1483f88-b753-4a1f-83c2-de63398a1ccb None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:24.078260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5a5e7-ae9d-467c-857c-88d3cd5dff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:24.079020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5a5e7-ae9d-467c-857c-88d3cd5dff65 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.079372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5a5e7-ae9d-467c-857c-88d3cd5dff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.079716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5a5e7-ae9d-467c-857c-88d3cd5dff65 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.080522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5a5e7-ae9d-467c-857c-88d3cd5dff65 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:24.080899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5a5e7-ae9d-467c-857c-88d3cd5dff65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:24.082732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5a5e7-ae9d-467c-857c-88d3cd5dff65 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:24.088828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 356/703] 10.222.0.87 () {56 vars in 1145 bytes} [Wed Feb 16 18:01:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:24.099744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:24.114776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6dc7-093b-4eb6-b0d7-8e244240e282 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:24.119920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc70027-a206-40fd-acbb-22b4212401c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:24.120930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70027-a206-40fd-acbb-22b4212401c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.121982 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70027-a206-40fd-acbb-22b4212401c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.122436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc70027-a206-40fd-acbb-22b4212401c3 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.123401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70027-a206-40fd-acbb-22b4212401c3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:24.123873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70027-a206-40fd-acbb-22b4212401c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:24.125737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc70027-a206-40fd-acbb-22b4212401c3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:24.135347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 348/704] 10.222.0.87 () {56 vars in 1145 bytes} [Wed Feb 16 18:01:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:24.643189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d9208-e7f6-4703-834e-ba194cf0a928 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.643734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d9208-e7f6-4703-834e-ba194cf0a928 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.643734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d9208-e7f6-4703-834e-ba194cf0a928 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.645832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 357/705] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:24.651174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521a289-0b40-44e3-bf32-656bc928cd40 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.651468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521a289-0b40-44e3-bf32-656bc928cd40 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.651749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521a289-0b40-44e3-bf32-656bc928cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.818491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c521a289-0b40-44e3-bf32-656bc928cd40 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:24.819719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c521a289-0b40-44e3-bf32-656bc928cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:24.833209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 349/706] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:24.857308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d9208-e7f6-4703-834e-ba194cf0a928 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:24.872260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d9208-e7f6-4703-834e-ba194cf0a928 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:24.876785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:24.877617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.877905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.878184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.889489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:24.896896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:24.903895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 358/707] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:24.905426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521a289-0b40-44e3-bf32-656bc928cd40 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:24.914994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521a289-0b40-44e3-bf32-656bc928cd40 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:24.920388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:24.921071 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.921359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.921640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.922460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:24.922773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:24.924389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:24.938657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 350/708] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:24.940034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:24.950860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b18e-5b83-4305-afdc-baf57dd876c4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:24.955769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:24.956576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:24.956862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:24.957148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:24.970126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:24.972088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:24.991371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:24.997207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 359/709] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:24.998960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.010342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d673c-9cb1-4d87-b5c9-d3b55541a6b2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.015442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.016189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.016479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.016760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.017530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.017844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.019600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.040498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 351/710] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:25.042055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.053874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa738a-8c2f-4761-b575-f26e2ae2b34c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.058916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.059854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.060178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.060514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.070748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.072875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.088405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 18:01:25.095908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 360/711] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:25.097439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.109400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1151efb-b729-4960-a639-88877218e7a9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.114297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.115036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.115323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.115625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.116683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.117064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.119060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.149343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 352/712] 10.222.0.87 () {56 vars in 1156 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:25.154893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.165312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec76882-3339-44a2-b85b-7b7d96de6ddd admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.171061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.171739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.172026 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.172290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.181798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.183627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.201118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 361/713] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:01:25.202074 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.224735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86332b9a-1288-4a46-9621-593c87c96b5b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.233910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.234756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.235045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.235325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.253072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.254996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.278281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:25.279932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 353/714] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:25.285298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.304194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd77eb2-a2e2-411a-b395-56f0ce0bf258 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.318390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.319346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.319835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.320315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.321677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.322212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.324626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.345429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 362/715] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:25.348065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.360365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cbb0a-1b41-4d46-b3e5-7a471e475d22 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.367898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.368724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.369013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.369335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.379143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.381368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.401777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:25.409050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 354/716] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:25.410498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.421838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c825f-ba7d-47f8-923f-fed09da58b9f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.426643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a020be7-5746-4e81-b5f8-26dc2dcfebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.427567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020be7-5746-4e81-b5f8-26dc2dcfebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.427854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020be7-5746-4e81-b5f8-26dc2dcfebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.428166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020be7-5746-4e81-b5f8-26dc2dcfebc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.428969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a020be7-5746-4e81-b5f8-26dc2dcfebc5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.429327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a020be7-5746-4e81-b5f8-26dc2dcfebc5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.431289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a020be7-5746-4e81-b5f8-26dc2dcfebc5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.449652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 363/717] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:25.451270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.461472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe9f71-d590-4cdf-a77c-19983a41b85a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.474313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896b70-26d5-482b-80f0-6cde1bb1878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.474313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896b70-26d5-482b-80f0-6cde1bb1878e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.474313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896b70-26d5-482b-80f0-6cde1bb1878e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.474313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896b70-26d5-482b-80f0-6cde1bb1878e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.475234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896b70-26d5-482b-80f0-6cde1bb1878e admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=9450573df8c6430a8271e86f15954d6c) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.475234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896b70-26d5-482b-80f0-6cde1bb1878e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.475234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896b70-26d5-482b-80f0-6cde1bb1878e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.480466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 355/718] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/role_assignments?user.id=9450573df8c6430a8271e86f15954d6c&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:25.587721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2b434-66b2-4f20-9129-ecea471ff36c None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.588167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2b434-66b2-4f20-9129-ecea471ff36c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.588311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2b434-66b2-4f20-9129-ecea471ff36c None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.590947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 364/719] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:25.596674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb8154-91fb-48be-bf0d-f497ce6f6375 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.597006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb8154-91fb-48be-bf0d-f497ce6f6375 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.597333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb8154-91fb-48be-bf0d-f497ce6f6375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.626353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-14fb8154-91fb-48be-bf0d-f497ce6f6375 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:25.627603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-14fb8154-91fb-48be-bf0d-f497ce6f6375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:25.635744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 356/720] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:25.671138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2b434-66b2-4f20-9129-ecea471ff36c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.688328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2b434-66b2-4f20-9129-ecea471ff36c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.697266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.698086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.698364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.698635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.719424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:25.726590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:01:25.728187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 365/721] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:25.734336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb8154-91fb-48be-bf0d-f497ce6f6375 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.746614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb8154-91fb-48be-bf0d-f497ce6f6375 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.757772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.758471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.758751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.759030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.759789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.760088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.761763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.777827 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 357/722] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:25.783099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.797589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc12ed-9f87-4559-a632-4f9ef1a72e9e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.805567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.806436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.806703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.807068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.823595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.826674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.847924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:25.849597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 366/723] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:25.855275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.866392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe3cf7-6e99-4667-a610-4b3e7d629488 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.872080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.872813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.873162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.873441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.874225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.874529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.876206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.890654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 358/724] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:25.896021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.906407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251d81-2e33-4935-b2b4-e91e9b0d0bb0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.911136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.911993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.912356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.912640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.921636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.923745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:25.949284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:01:25.952227 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 367/725] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:25.957966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:25.970066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdb9b5-0e90-43d7-a938-c024dfefa2c7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:25.976177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:25.977151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:25.977659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:25.978141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:25.979308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:25.979675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:25.983279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:26.008217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 359/726] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:01:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:26.014870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:26.030861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f30c3b-0759-46a6-a7d2-7cc8e99e147f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:26.035614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:26.036632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.037053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.037360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.051044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:26.053350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:26.073109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:26.074777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 368/727] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:26.080663 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:26.096155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0017b3-443c-4f69-9091-2f08e3ff0cde admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:26.101919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:26.102698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.103064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.103450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.104752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:26.105864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:26.108831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:26.128406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 360/728] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:26.134385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:26.150481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998c20-7266-4080-9d4b-d73299261a3b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:26.156617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:26.157794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.158356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.158828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.171188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:26.175523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:26.196766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:26.201108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 369/729] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:26.207379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:26.225059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435bd61-7832-494f-b2a9-58bd1c0dfd44 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:26.230956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db1cc1-6213-4dfc-94c7-84ee52225b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:26.231674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db1cc1-6213-4dfc-94c7-84ee52225b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.231955 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db1cc1-6213-4dfc-94c7-84ee52225b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.232405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db1cc1-6213-4dfc-94c7-84ee52225b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.233327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db1cc1-6213-4dfc-94c7-84ee52225b57 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:26.233644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db1cc1-6213-4dfc-94c7-84ee52225b57 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:26.235499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db1cc1-6213-4dfc-94c7-84ee52225b57 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:26.250640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 361/730] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:26.256661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:26.268397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b15e-685a-4bc5-97f0-cc6c621f9ab6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:26.273377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecd284-a2d1-4311-a5bc-a5013f1cf24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:26.274323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecd284-a2d1-4311-a5bc-a5013f1cf24b admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.274602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecd284-a2d1-4311-a5bc-a5013f1cf24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.274874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecd284-a2d1-4311-a5bc-a5013f1cf24b admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/28dfb9c84dda4d6799a490a009e867df/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.277070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecd284-a2d1-4311-a5bc-a5013f1cf24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=28dfb9c84dda4d6799a490a009e867df, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:26.281244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecd284-a2d1-4311-a5bc-a5013f1cf24b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:26.436952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 370/731] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:26 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/28dfb9c84dda4d6799a490a009e867df/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:26.827336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46604-8ca4-4972-a228-7161b78c6b34 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.827336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46604-8ca4-4972-a228-7161b78c6b34 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.827336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46604-8ca4-4972-a228-7161b78c6b34 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.828734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 362/732] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:26.834356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbdaed-e729-4595-9362-7884092e9ed1 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.834997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbdaed-e729-4595-9362-7884092e9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.834997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbdaed-e729-4595-9362-7884092e9ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.862647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b1dbdaed-e729-4595-9362-7884092e9ed1 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:26.863999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b1dbdaed-e729-4595-9362-7884092e9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:26.905408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fbb-3a1a-46c6-be33-303d904cb99b None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.906145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fbb-3a1a-46c6-be33-303d904cb99b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.906628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fbb-3a1a-46c6-be33-303d904cb99b None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.908926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 363/733] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:26.929012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb039ad-c947-4795-b0ec-cfd11d576546 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:26.929501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb039ad-c947-4795-b0ec-cfd11d576546 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:26.929687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb039ad-c947-4795-b0ec-cfd11d576546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:26.934779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 371/734] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:26.970791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2cb039ad-c947-4795-b0ec-cfd11d576546 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:26.972697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2cb039ad-c947-4795-b0ec-cfd11d576546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:26.989204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 364/735] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 18:01:26.997955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbdaed-e729-4595-9362-7884092e9ed1 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.007520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbdaed-e729-4595-9362-7884092e9ed1 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.015462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb039ad-c947-4795-b0ec-cfd11d576546 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.017171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.017996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.018279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.018558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.028896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb039ad-c947-4795-b0ec-cfd11d576546 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.037126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:27.045610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:27.047580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 372/736] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:27.048574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.049597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.050085 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.050556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.051499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.053094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:27.053094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:27.053094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:27.054227 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.059876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.070717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb887d-4ace-4716-964c-10973ab25315 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.079563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.079563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.079563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.079563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.080480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:27.080988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.082948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.093934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 373/737] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:27.099165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.113930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475842c0-6478-41dd-a348-7a3a96b09196 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.119589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.121615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.123440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.127944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.139520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.141927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.163691 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:27.165752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 374/738] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:27.172295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.187975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 365/739] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:27 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:27.192173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344942-360d-49c0-95f8-854946c70329 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.217496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.218486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.218986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.219435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.220310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:27.220798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.222752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.243115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 375/740] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:27.249877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.264040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb47b20-7d08-42f7-bd97-b121e905353e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.269284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.270456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.270973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.271403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.283025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.285348 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.301680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 18:01:27.303815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 366/741] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:27.310419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.329352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bec7-26a9-499b-b4a7-4d886bc5eb57 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.337181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c78bd-834f-4d9a-b924-add4f4022513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.338236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c78bd-834f-4d9a-b924-add4f4022513 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.338714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c78bd-834f-4d9a-b924-add4f4022513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.339204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c78bd-834f-4d9a-b924-add4f4022513 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.340551 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c78bd-834f-4d9a-b924-add4f4022513 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:27.341208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c78bd-834f-4d9a-b924-add4f4022513 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.343485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c78bd-834f-4d9a-b924-add4f4022513 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.375146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 376/742] 10.222.0.87 () {56 vars in 1170 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:27.381637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.394450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5018b7-729b-46d5-ae76-99f625600d04 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.406812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.407851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.408292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.408773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.412730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00dc33-f9e7-44bd-956b-5abdc06aa608 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.413337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00dc33-f9e7-44bd-956b-5abdc06aa608 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.413833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00dc33-f9e7-44bd-956b-5abdc06aa608 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.415967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 377/743] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:27.428281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.430361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.445136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9938cd-e713-4664-92e2-b8d7f6b21870 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.445136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9938cd-e713-4664-92e2-b8d7f6b21870 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.445136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9938cd-e713-4664-92e2-b8d7f6b21870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.450909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 367/744] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/auth/tokens => generated 1013 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:01:27.459742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.464041 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7d9938cd-e713-4664-92e2-b8d7f6b21870 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:27.465870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7d9938cd-e713-4664-92e2-b8d7f6b21870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:27.471926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d1d97-2f38-4c83-ae93-8f355a6e1605 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.482228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.483053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 378/745] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:27 2022] POST /identity/v3/auth/tokens => generated 1013 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:27.489156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.489156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.489156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.500558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.502618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.509172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9938cd-e713-4664-92e2-b8d7f6b21870 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.520987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9938cd-e713-4664-92e2-b8d7f6b21870 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.522048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:27.523805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 368/746] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:27.530049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.530742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.531028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.531306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.532075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.533142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:27.533142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:01:27.533142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:01:27.534055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.534780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.548393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690423-d36b-4f76-9b39-d01aba585d0c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.554280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.555319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.561007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.561007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.561007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:27.561007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.561007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.574633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 369/747] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:27.579963 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.592111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250d226-6c37-44d5-8653-b0d112fd6483 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.597073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.598414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.598834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.599154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.607365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.609417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.624536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 379/748] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:27 2022] POST /identity/v3/services => generated 251 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:27.629607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:27.629607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 370/749] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:27.633246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.681578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c760-ccd0-493e-85dd-94dd1b4d1443 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.690039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7060a-b5f9-46b3-b80d-d455d04fedce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.691028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7060a-b5f9-46b3-b80d-d455d04fedce admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.691460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7060a-b5f9-46b3-b80d-d455d04fedce admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.691885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7060a-b5f9-46b3-b80d-d455d04fedce admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.692867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7060a-b5f9-46b3-b80d-d455d04fedce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:27.693366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7060a-b5f9-46b3-b80d-d455d04fedce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.695541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7060a-b5f9-46b3-b80d-d455d04fedce admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.727640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 380/750] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:27.733810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:27.750880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06541c-dcab-4004-9bd0-e011c77845b0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:27.759997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7489e0-dd03-4119-ad0b-c217a2a842a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:27.760671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7489e0-dd03-4119-ad0b-c217a2a842a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:27.761008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7489e0-dd03-4119-ad0b-c217a2a842a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:27.761312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7489e0-dd03-4119-ad0b-c217a2a842a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:27.763066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7489e0-dd03-4119-ad0b-c217a2a842a3 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=266555accbbd443fa51c26734d5a2f3b) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:27.763438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7489e0-dd03-4119-ad0b-c217a2a842a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:27.765336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7489e0-dd03-4119-ad0b-c217a2a842a3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:27.779215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 371/751] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:27 2022] GET /identity/v3/role_assignments?user.id=266555accbbd443fa51c26734d5a2f3b&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:29.106214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95869a7d-a4ef-4dd9-bf67-7685608ad7e0 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.106775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95869a7d-a4ef-4dd9-bf67-7685608ad7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.106775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95869a7d-a4ef-4dd9-bf67-7685608ad7e0 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.108920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 381/752] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:29.114786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ba90d-ac82-437f-a178-ee44b82376ef None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.115265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ba90d-ac82-437f-a178-ee44b82376ef None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.115336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ba90d-ac82-437f-a178-ee44b82376ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.137585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-809ba90d-ac82-437f-a178-ee44b82376ef None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:29.138803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-809ba90d-ac82-437f-a178-ee44b82376ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:29.151571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 372/753] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:29 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:29.195425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95869a7d-a4ef-4dd9-bf67-7685608ad7e0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.216823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95869a7d-a4ef-4dd9-bf67-7685608ad7e0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.229803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.231350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.231638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.232075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.251301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:29.258322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:01:29.264174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 382/754] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:29.266124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ba90d-ac82-437f-a178-ee44b82376ef None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.286990 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ba90d-ac82-437f-a178-ee44b82376ef None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.303860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.304999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.305495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.305957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.307318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:29.307857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.310339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.320024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 373/755] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:29.326542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.343577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55b1a-8312-43de-bbbe-35a691d81e25 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.353594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.358747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.358747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.358747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.377538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.379571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.409395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:29.415007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 383/756] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:29.416465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.430723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00c790-c3bd-4927-b098-3419d07ba3d5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.441649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.442333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.442617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.442897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.443626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:29.443934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.445567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.467594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 374/757] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:29.472859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.486633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9018e-d4f9-45dc-8cbe-9b687d1e47e3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.495148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d356-7feb-4a93-8487-5f8e25b3d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.496494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d356-7feb-4a93-8487-5f8e25b3d8db admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.496778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d356-7feb-4a93-8487-5f8e25b3d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.497051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d356-7feb-4a93-8487-5f8e25b3d8db admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.514700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d356-7feb-4a93-8487-5f8e25b3d8db admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.518410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d356-7feb-4a93-8487-5f8e25b3d8db admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.541716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f905d356-7feb-4a93-8487-5f8e25b3d8db admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 18:01:29.543171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 384/758] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:29.549234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.566607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f79c-211a-4085-84a5-1d6e33282321 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.578876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.579575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.579859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.580133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.580970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:29.581328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.583219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.616136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b1c15-35a4-44d5-aabe-c1571dab4ae6 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.616451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b1c15-35a4-44d5-aabe-c1571dab4ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.616625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b1c15-35a4-44d5-aabe-c1571dab4ae6 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.618419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 385/759] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:29.620710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 375/760] 10.222.0.87 () {56 vars in 1156 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:29.624246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8e07-b540-4f03-a5be-613165c69703 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.624579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8e07-b540-4f03-a5be-613165c69703 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.624871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8e07-b540-4f03-a5be-613165c69703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.625998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.647259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c0ddc-c9d5-41f9-9bd3-cdf83ec0523a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.656936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.657623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.657908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.658186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.659647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-994a8e07-b540-4f03-a5be-613165c69703 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:29.660864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-994a8e07-b540-4f03-a5be-613165c69703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:29.673353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.675121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.685539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 376/761] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:01:29.690773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 386/762] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:29 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:29.699671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.712101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6ceb4-d9a5-4580-a5f3-dfa714de7c53 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.717419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8e07-b540-4f03-a5be-613165c69703 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.725806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.726741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.727082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.727360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.728575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8e07-b540-4f03-a5be-613165c69703 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.733293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.734196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.734484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.734744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.744729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.746768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.762390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:29.774563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:01:29.775836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 387/763] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:29.780996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:29.782207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.787699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 377/764] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:29.789622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.799371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eb65a-9862-4c2e-9a49-abcf787453dc admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.807641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1985fea-d75b-4b4f-b693-5e35dfdd25c7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.811165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.811849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.812184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.812474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.813680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:29.813997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.816825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.820242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.820964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.821279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.821552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.823104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:29.824984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.828579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.839643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 388/765] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:29.842405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 378/766] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:29.845784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.848446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.857771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c04c-1887-49f4-970c-4b7642bc3c08 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.862613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.863413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.863697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.863974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.868089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb131db-7017-445f-b8ae-edeebfdfd0ae admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.875798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.877927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.887323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.888014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.888385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.888855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.899585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:29.900506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.905314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 389/767] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:29.907962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.913492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.918575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3a6d0-47e4-48e0-acf8-72e5d3f4f478 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.923371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.924123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.924408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.924684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.925489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:29.925798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.927761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.940785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:29.941183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 390/768] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:29.942490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 379/769] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:29.946740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.948088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:29.958156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148f72-1efd-48d8-a5ca-921ab9f5e0b1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.962804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384cd80-7cb1-4a16-b1c8-6d170abeb729 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:29.963115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.963974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.964263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.964543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.975048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.977237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.981800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:29.982480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:29.982761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:29.983041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:29.983828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:29.984137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:29.986020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:29.992268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:01:29.993893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 391/770] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:29.999833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.008860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 380/771] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:30.010277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd8017-b9ab-4033-a453-dac94161dfc2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.015285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.016043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.016770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.017064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.017430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.018340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.018655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.020637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.039865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c5d34-8225-47e1-a63b-086eeedbd208 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.042607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 392/772] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:01:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:30.048318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.055125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.056254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.056732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.057198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.058058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=578059b701674f41b39442d2a018b489, user.id=9450573df8c6430a8271e86f15954d6c) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.058920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.060170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32918e7-fdb7-4fa8-b87b-1e7811ce81c8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.062173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.065039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.065783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.066126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.066410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.075751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.077929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.078874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 381/773] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/role_assignments?user.id=9450573df8c6430a8271e86f15954d6c&scope.project.id=578059b701674f41b39442d2a018b489&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:30.090263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 393/774] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:01:30.096090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.115166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560ae4-1e9f-416a-8357-ddc3efe5b4d3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.121407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.122832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.123377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.123904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.146117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.148510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.172540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:30.174221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 382/775] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:30.182653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.194030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f999-98bb-48af-a182-580e38d03fc4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.203824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.204457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.204728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.205054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.205837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.206143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.207753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.226173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 394/776] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:30.233976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.252459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315c0d1-ac1f-4c80-80cb-89346c7214d8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.259828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.261321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.262417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.262886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.282444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.284637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.301120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:30.303121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 383/777] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:30.309759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.320908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210500e-e9b2-47ff-8bf9-c9edd59427e3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.326718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830714f-26d7-4c83-a396-8301d8cc7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.327450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830714f-26d7-4c83-a396-8301d8cc7c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.327735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830714f-26d7-4c83-a396-8301d8cc7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.328066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830714f-26d7-4c83-a396-8301d8cc7c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.328926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830714f-26d7-4c83-a396-8301d8cc7c4f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.329260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830714f-26d7-4c83-a396-8301d8cc7c4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.331501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830714f-26d7-4c83-a396-8301d8cc7c4f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.346304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 395/778] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:30.352537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.363109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3437788-2a44-40b1-b123-fa49015c1f58 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.368034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6ba14-1b56-49da-a71a-4d5394a316ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.368751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ba14-1b56-49da-a71a-4d5394a316ea admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.369038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ba14-1b56-49da-a71a-4d5394a316ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.369384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6ba14-1b56-49da-a71a-4d5394a316ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.370338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ba14-1b56-49da-a71a-4d5394a316ea admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=578059b701674f41b39442d2a018b489, user.id=28dfb9c84dda4d6799a490a009e867df) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.370652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ba14-1b56-49da-a71a-4d5394a316ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.373328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6ba14-1b56-49da-a71a-4d5394a316ea admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.381351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 384/779] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/role_assignments?user.id=28dfb9c84dda4d6799a490a009e867df&scope.project.id=578059b701674f41b39442d2a018b489&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:30.519926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b03dd-0842-4242-9c81-6d1f92d3c972 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.520298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b03dd-0842-4242-9c81-6d1f92d3c972 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.520469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b03dd-0842-4242-9c81-6d1f92d3c972 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.522432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 396/780] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:30.529479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3201e16-ec95-4230-a3a3-1233c51882ea None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.529803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3201e16-ec95-4230-a3a3-1233c51882ea None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.530034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3201e16-ec95-4230-a3a3-1233c51882ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.555458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e3201e16-ec95-4230-a3a3-1233c51882ea None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:30.556709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e3201e16-ec95-4230-a3a3-1233c51882ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:30.568097 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 385/781] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:30 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:30.595448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b03dd-0842-4242-9c81-6d1f92d3c972 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.611332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b03dd-0842-4242-9c81-6d1f92d3c972 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.616903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.617789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.618070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.618344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.619015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.620915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.633735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 18:01:30.635216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 397/782] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:30.641658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3201e16-ec95-4230-a3a3-1233c51882ea None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.659327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3201e16-ec95-4230-a3a3-1233c51882ea None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.664013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.664753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.665038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.665345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.666121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.666428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.668412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.683043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 386/783] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:30.688988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.700380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddace3-b1c9-40ff-960e-f9294d7c6291 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.705638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.706927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.707684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.708455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.709835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.710369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.712180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.719809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 398/784] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:30.726526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.742445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d720-d923-47b6-8ee7-1ec28f2085a5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.753498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.754540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.755038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.755503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.756512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] RBAC: Adding query filter params (interface=public, service_id=d07807d73aa047d981136b99f16e8ae0, region_id=RegionOne) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.757032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.758277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:30.758277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:30.758277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:30.759552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41845-1fb6-416c-8076-c1c77b998367 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.775327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 387/785] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/endpoints?service_id=d07807d73aa047d981136b99f16e8ae0&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:30.781364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.797586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497aec7-e1fd-40cd-9952-8b6aec8479e0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.801365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b38c-f7fe-4809-bbf0-f28320a45f86 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.801965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b38c-f7fe-4809-bbf0-f28320a45f86 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.802696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b38c-f7fe-4809-bbf0-f28320a45f86 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.804807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 388/786] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:30.809141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.809141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.809141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.809141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.809665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.811645 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:30.812733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e9810-99c3-4493-bb33-8e8ddfa22ee4 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.813417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e9810-99c3-4493-bb33-8e8ddfa22ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.813952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e9810-99c3-4493-bb33-8e8ddfa22ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.819721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 399/787] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:30.834716 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-bb3e9810-99c3-4493-bb33-8e8ddfa22ee4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:30.835938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-bb3e9810-99c3-4493-bb33-8e8ddfa22ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:30.844327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 389/788] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:30 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:30.867489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.878758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65959900-58d0-4d76-8958-f4d995b096e5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.889217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.889982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.890418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.890697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.914319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:30.922622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:30.929005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 400/789] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:30.933974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e9810-99c3-4493-bb33-8e8ddfa22ee4 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:30.958488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e9810-99c3-4493-bb33-8e8ddfa22ee4 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:30.986482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c5334-a043-493a-9e8f-ce2a0307db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:30.988155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5334-a043-493a-9e8f-ce2a0307db20 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:30.988919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5334-a043-493a-9e8f-ce2a0307db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:30.989691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c5334-a043-493a-9e8f-ce2a0307db20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:30.990891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5334-a043-493a-9e8f-ce2a0307db20 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:30.991489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5334-a043-493a-9e8f-ce2a0307db20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:30.993464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c5334-a043-493a-9e8f-ce2a0307db20 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.014796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 390/790] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:31.023255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.040572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1d9d-d69f-466a-93fb-e036e5949ec9 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.040909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1d9d-d69f-466a-93fb-e036e5949ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.041165 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1d9d-d69f-466a-93fb-e036e5949ec9 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.047393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 391/791] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:31.049755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493469c-0744-424a-b06a-c2c9ab56c18c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.058626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.059505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.059792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.060070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.062507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7cf21-701c-4035-8da8-384aad689948 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.062820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7cf21-701c-4035-8da8-384aad689948 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.063078 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7cf21-701c-4035-8da8-384aad689948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.093032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.095275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.096998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c3b7cf21-701c-4035-8da8-384aad689948 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:31.098265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c3b7cf21-701c-4035-8da8-384aad689948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:31.113526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 392/792] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:31 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:31.129249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:31.135745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 401/793] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:31.136888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7cf21-701c-4035-8da8-384aad689948 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.149711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.155258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7cf21-701c-4035-8da8-384aad689948 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.163213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95a74-e5cd-43b0-913c-38bee8d2e16f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.165715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.166400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.166687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.166974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.167684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:31.168601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.170451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.173163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.174822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.175304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.175777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.176629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.178722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.187639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 393/794] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:31.197141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.199884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 18:01:31.204918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 402/795] 10.222.0.87 () {56 vars in 1150 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:31.212922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.218081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceea2e5-a7fb-40c3-917e-63241bf3d4ab admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.224902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.225920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.226365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.226713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.236508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.236960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdf092-12f4-4549-a75c-b5f5e2bc433f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.238735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.249742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.250680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.251106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.251523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.252807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:31.253550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.255996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.258586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 18:01:31.265185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 394/796] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:31.266528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.272440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 403/797] 10.222.0.87 () {56 vars in 1145 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:31.278435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.284857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6196d5-44cc-4632-901b-c8fc6718d80e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.298481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.300682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.301186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.302069 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9a34d-f40e-4bd6-a6c9-1f2ebd2ab657 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.303276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.304280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:31.305279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.312451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.316556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.317264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.317593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.317900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.318666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:31.318970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.320756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.335209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 404/798] 10.222.0.87 () {56 vars in 1145 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:31.343298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.362905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3df7-e7c3-4f39-9068-032c9c2c0b03 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.367566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 395/799] 10.222.0.87 () {56 vars in 1170 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:31.373376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.378339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.380085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.380454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.380740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.383568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] RBAC: Adding query filter params (interface=public, service_id=e36c5edbddb84f3bb1193b51762e5c5c, region_id=RegionOne) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:31.384351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.388207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:31.388207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:01:31.388207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:01:31.389308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.392041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe60a5b-229e-4a54-b5d5-3c1fcde6cf4f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.403267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.403996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.404355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.404635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.406580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 405/800] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/endpoints?service_id=e36c5edbddb84f3bb1193b51762e5c5c&interface=public®ion_id=RegionOne => generated 194 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:31.413944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.429200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c0c6c-3312-4b91-b20f-66392946eb5f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.435768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.435768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.450924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.451592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.451923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.452198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.452937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.457172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.472873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 406/801] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/services => generated 772 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:31.478606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:31.481355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 396/802] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:31.490288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.507925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf41f5-4061-44a6-8ad1-26e9fff5ec43 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.514456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.515175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.515716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.516204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.517717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:31.518328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.520190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.539679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 407/803] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:31.545849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.559941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd43e07-5c3c-4466-bdc0-fe92ac434ae3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.574034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.574938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.575214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.575492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.591086 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.593600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.612132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:31.613879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 397/804] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:31.619577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.639614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f991ea-c20e-46bf-be58-45a2f5cf0a17 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.646858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfb806-51e6-49bc-86b5-ee5b3a901006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.647548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfb806-51e6-49bc-86b5-ee5b3a901006 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.647829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfb806-51e6-49bc-86b5-ee5b3a901006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.648103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfb806-51e6-49bc-86b5-ee5b3a901006 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.648909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfb806-51e6-49bc-86b5-ee5b3a901006 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:31.649260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfb806-51e6-49bc-86b5-ee5b3a901006 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.651231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfb806-51e6-49bc-86b5-ee5b3a901006 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.671893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 408/805] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:31.678217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:31.698757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb0eed-56a2-4c32-8879-1cd65efc7c5c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:31.710034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd95e2-c923-4d18-a58c-d1280775ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:31.710957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd95e2-c923-4d18-a58c-d1280775ab2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:31.711241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd95e2-c923-4d18-a58c-d1280775ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:31.711524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd95e2-c923-4d18-a58c-d1280775ab2b admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/266555accbbd443fa51c26734d5a2f3b/roles/103afb794083469bba2437eec01fd04b` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:31.737832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd95e2-c923-4d18-a58c-d1280775ab2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=266555accbbd443fa51c26734d5a2f3b, role_id=103afb794083469bba2437eec01fd04b)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:31.740588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd95e2-c923-4d18-a58c-d1280775ab2b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:31.825695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 398/806] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:31 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/266555accbbd443fa51c26734d5a2f3b/roles/103afb794083469bba2437eec01fd04b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:33.048298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd29c-e0c4-4c2c-a4e6-15a185245dc8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.049369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd29c-e0c4-4c2c-a4e6-15a185245dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.049865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edd29c-e0c4-4c2c-a4e6-15a185245dc8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.052380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 409/807] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:33.060637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c66e0-dd66-48d2-8545-77be82aabd69 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.062037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c66e0-dd66-48d2-8545-77be82aabd69 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.062781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c66e0-dd66-48d2-8545-77be82aabd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.096120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-bc4c66e0-dd66-48d2-8545-77be82aabd69 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:33.097787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-bc4c66e0-dd66-48d2-8545-77be82aabd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:33.232549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 399/808] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:33 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:33.270995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edd29c-e0c4-4c2c-a4e6-15a185245dc8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.289806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edd29c-e0c4-4c2c-a4e6-15a185245dc8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.295616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.296725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.297243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.297728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.319108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:33.327885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:01:33.329429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 410/809] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:33.335767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c66e0-dd66-48d2-8545-77be82aabd69 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.349376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c66e0-dd66-48d2-8545-77be82aabd69 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.357482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.358190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.358900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.358900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.359501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:33.359811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.361528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.377310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 400/810] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:33.382936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.407075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390697-b9bb-44e9-a66c-c94fa883197b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.414885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.416482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.417160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.418254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.435939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.438330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.468157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:33.469827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 411/811] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:33.475600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.499492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74e7e-2c57-4f9a-bc85-734cbbf51a4b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.510425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.511346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.512409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.512913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.514423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:33.514976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.517450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.541572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 401/812] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:33.548514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.565106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e43a-84bd-43ba-860c-0dde41a41aa6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.573129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.574925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.575657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.576404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.589765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.593109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.617987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 18:01:33.619929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 412/813] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:33.625593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.643015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a37be-9ff0-40a7-a298-37632acd427d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.650918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf9aa0-cc35-4c20-abff-7714ab3996dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.651760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf9aa0-cc35-4c20-abff-7714ab3996dd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.652943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf9aa0-cc35-4c20-abff-7714ab3996dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.653175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf9aa0-cc35-4c20-abff-7714ab3996dd admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.654319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf9aa0-cc35-4c20-abff-7714ab3996dd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:33.654735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf9aa0-cc35-4c20-abff-7714ab3996dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.656719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf9aa0-cc35-4c20-abff-7714ab3996dd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.688070 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 402/814] 10.222.0.87 () {56 vars in 1156 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:33.693269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.700578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dd68b-20f0-4cef-82bb-30286944c413 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.701198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dd68b-20f0-4cef-82bb-30286944c413 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.702141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dd68b-20f0-4cef-82bb-30286944c413 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.708973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 403/815] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:33.711023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5c8d-f8c2-465d-bb19-4d4a58af43bf None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.711504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5c8d-f8c2-465d-bb19-4d4a58af43bf None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.711947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5c8d-f8c2-465d-bb19-4d4a58af43bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.712271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf6e8b-a8bf-4cc2-a5e5-27cbcb922aab admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.728704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.729609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.729906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.730191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.750164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4eae5c8d-f8c2-465d-bb19-4d4a58af43bf None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:33.751270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4eae5c8d-f8c2-465d-bb19-4d4a58af43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:33.753211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.755144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.772102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 404/816] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:33 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:33.781239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:33.783650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 413/817] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:33.790068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae5c8d-f8c2-465d-bb19-4d4a58af43bf None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.804190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.805821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae5c8d-f8c2-465d-bb19-4d4a58af43bf None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.817794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.818847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.819411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.819885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.819987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202f536-4e0f-4ca9-a834-75994bfc1f2f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.820919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:33.821484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.823412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.833113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.833113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.833113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.833113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.833533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.833987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.851983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 405/818] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:33.858901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.860179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 18:01:33.862546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 414/819] 10.222.0.87 () {56 vars in 1153 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:33.872549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.877996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0e450-9921-471e-a776-2d8fbef9dd75 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.889780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.892055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.892756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.893693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.897155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bca118-b5ad-4efb-8fe2-3e571c42b067 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.909722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.910684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.911603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.913561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.914083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.915328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.915978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:33.916498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.920778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.931791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 415/820] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:33.937741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.949632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:33.955450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283792f4-43c7-4a8f-baf2-fa4e4c533c8d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.955799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 406/821] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:33.962567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:33.976029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.977241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.977736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.978208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.979191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:33.979681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:33.984483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:33.985095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52d284-d98b-4d84-9520-61d25ae5e798 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:33.994283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 416/822] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:33.995220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435360-b1d3-4f01-9ca8-7b05dce68271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:33.996247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435360-b1d3-4f01-9ca8-7b05dce68271 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:33.996742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435360-b1d3-4f01-9ca8-7b05dce68271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:33.997471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435360-b1d3-4f01-9ca8-7b05dce68271 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:33.998558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435360-b1d3-4f01-9ca8-7b05dce68271 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:33.999061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435360-b1d3-4f01-9ca8-7b05dce68271 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.001469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae435360-b1d3-4f01-9ca8-7b05dce68271 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.015635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 407/823] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:34.022137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.034856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01a61a-ad7a-4dc2-884b-2358f1f99377 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.044695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac9edf-3cd1-4045-9083-02271a27dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.046074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac9edf-3cd1-4045-9083-02271a27dc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.046541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac9edf-3cd1-4045-9083-02271a27dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.047063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac9edf-3cd1-4045-9083-02271a27dc08 admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/9450573df8c6430a8271e86f15954d6c/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.052263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac9edf-3cd1-4045-9083-02271a27dc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=9450573df8c6430a8271e86f15954d6c, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.056153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac9edf-3cd1-4045-9083-02271a27dc08 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.203334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 417/824] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:34 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/9450573df8c6430a8271e86f15954d6c/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:34.414304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d1a67-8be0-4b24-bd12-be9a53583ee3 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.415504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d1a67-8be0-4b24-bd12-be9a53583ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.415976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d1a67-8be0-4b24-bd12-be9a53583ee3 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.418577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 408/825] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:34.425373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c500fd-5f91-4322-b441-4cab69b12d76 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.425967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c500fd-5f91-4322-b441-4cab69b12d76 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.426423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c500fd-5f91-4322-b441-4cab69b12d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.450559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-78c500fd-5f91-4322-b441-4cab69b12d76 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:34.452229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-78c500fd-5f91-4322-b441-4cab69b12d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:34.525535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317429-bac6-4ee2-a023-c74850917c27 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.525927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317429-bac6-4ee2-a023-c74850917c27 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.526290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317429-bac6-4ee2-a023-c74850917c27 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.529035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 409/826] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:34.531575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 418/827] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:34 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:34.534609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3bf83-c4d3-4ca1-8fa1-aaa1c1082225 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.534864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3bf83-c4d3-4ca1-8fa1-aaa1c1082225 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.535186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3bf83-c4d3-4ca1-8fa1-aaa1c1082225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.566364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c500fd-5f91-4322-b441-4cab69b12d76 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.580261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c500fd-5f91-4322-b441-4cab69b12d76 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.584287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-3dc3bf83-c4d3-4ca1-8fa1-aaa1c1082225 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:34.584287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3dc3bf83-c4d3-4ca1-8fa1-aaa1c1082225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:34.593225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.594295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.595094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.595558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] PATH_INFO: `/v3/services/network` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.596937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.600195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.600604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 410/828] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:34 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:34.622124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 18:01:34.624198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 419/829] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:34 2022] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:34.630409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3bf83-c4d3-4ca1-8fa1-aaa1c1082225 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.647098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3bf83-c4d3-4ca1-8fa1-aaa1c1082225 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.656278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.657402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.657924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.658363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.659295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] RBAC: Adding query filter params (name=network) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:34.659771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.661635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.674188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 411/830] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:34.677810 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.691489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.700882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9189e-b5ec-4da1-a645-f489e0faf98e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.704794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66cfcc-b3e7-4510-8394-ab0cff139e5f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.711624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.713140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.714116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.715185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.716584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:34.717827 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.718745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.720672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.721747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.722209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.722685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.725363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.727405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.735574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 412/831] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:34.742002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.755924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 18:01:34.758776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 420/832] 10.222.0.87 () {56 vars in 1150 bytes} [Wed Feb 16 18:01:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:34.767870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7392d14-8d6e-412a-8168-dd9e15b58389 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.771206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.781628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.782597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.783034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.783481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.784382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.785626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:34.785626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:01:34.785626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:01:34.787043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.789416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b712d-ef2a-4b67-b0d1-1219e575e09f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.802788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.803762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.804200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.804660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.805578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:34.806037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.807849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.818148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 421/833] 10.222.0.87 () {56 vars in 1145 bytes} [Wed Feb 16 18:01:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:34.824022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.835559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82a8f1-4cc7-4a4e-ac7a-78df59d644b0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.841435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09b1b7-1d0b-4aa3-9b4e-a409685f355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.842488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b1b7-1d0b-4aa3-9b4e-a409685f355d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.842818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b1b7-1d0b-4aa3-9b4e-a409685f355d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.843099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b1b7-1d0b-4aa3-9b4e-a409685f355d admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.843839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09b1b7-1d0b-4aa3-9b4e-a409685f355d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:34.844143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09b1b7-1d0b-4aa3-9b4e-a409685f355d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.845871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09b1b7-1d0b-4aa3-9b4e-a409685f355d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.851758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 422/834] 10.222.0.87 () {56 vars in 1145 bytes} [Wed Feb 16 18:01:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:34.852943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7adcf-b5f9-473b-8068-62dff167298f None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.853434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7adcf-b5f9-473b-8068-62dff167298f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.853593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7adcf-b5f9-473b-8068-62dff167298f None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.855710 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 423/835] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:34.863950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a836e7-eeb0-44e6-a00e-7e6383ca1012 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.864334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a836e7-eeb0-44e6-a00e-7e6383ca1012 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.864751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a836e7-eeb0-44e6-a00e-7e6383ca1012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.884781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d6a836e7-eeb0-44e6-a00e-7e6383ca1012 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:34.886050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d6a836e7-eeb0-44e6-a00e-7e6383ca1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:34.895550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 424/836] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:34 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:34.896129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a836e7-eeb0-44e6-a00e-7e6383ca1012 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.907525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a836e7-eeb0-44e6-a00e-7e6383ca1012 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.912836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.914000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.914526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.915048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:34.916220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:34.918424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:01:34.918424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:01:34.918424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:01:34.920148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:34.941374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 413/837] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:34.945274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:34.983859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221037-8a73-4f10-adb7-76de0586c9b2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:34.989746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:34.991449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:34.992221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:34.992944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.009110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:35.018636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:01:35.020319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 414/838] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:01:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:35.028609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.041596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdedff-451f-41f3-8300-4fee2119cc51 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.044015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 425/839] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:35.064572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.065780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.066328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.066822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.067859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:35.068378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.070527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.083956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 415/840] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:35.094298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.112440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84096-ac1c-4b28-89a8-1453a29ebd2b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.123674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.124658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.125018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.125401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.146618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.148615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.179159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:35.180825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 426/841] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:35.187103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.205122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e159936-c4ee-47ae-89f5-dc01439a6f99 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.235559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.236224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.236516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.236802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.237644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:35.237957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.239720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.264617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 416/842] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:35.269750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.282029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae57a3-408f-4526-babe-79f30565ced0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.288249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.289530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.290016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.290512 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.300932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.303825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.321259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 18:01:35.323254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 427/843] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:35.330086 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.341403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190e9c-95ca-4971-aaab-ae6de334a273 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.346814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.347868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.348356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.348830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.349941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:35.350475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.352559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.374935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 417/844] 10.222.0.87 () {56 vars in 1170 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:35.380875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.392820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a3b3-13b3-4594-9885-195ce6344d99 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.398217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.399410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.399930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.400422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.410393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.412684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.428761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 428/845] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:01:35.435780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.446566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8865844-72a8-44fd-8a7d-b5f0587219a4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.452646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.453664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.454030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.454465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.469005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.471013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.497240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:35.499168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 418/846] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:35.506245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.520575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d47d5-b95b-4271-8406-35c9d01fee29 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.528817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.530104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.530694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.533437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.534490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:35.534991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.536939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.553498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 429/847] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:35.559457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.571277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c46c33-26dd-4396-a93f-4064a8cad850 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.577350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.578618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.579079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.579552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.588870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.591692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.606224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:35.608406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 419/848] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:35.614556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.625239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb36673-b88f-4024-a990-3f8bbb16c9d4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.630177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ddc55-6a31-4b83-abc1-d5e1cdd3408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.631082 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ddc55-6a31-4b83-abc1-d5e1cdd3408b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.631540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ddc55-6a31-4b83-abc1-d5e1cdd3408b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.631999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ddc55-6a31-4b83-abc1-d5e1cdd3408b admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.632973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ddc55-6a31-4b83-abc1-d5e1cdd3408b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:35.633479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ddc55-6a31-4b83-abc1-d5e1cdd3408b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.635618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ddc55-6a31-4b83-abc1-d5e1cdd3408b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.650532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 430/849] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:35.658067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:35.671164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f549-727d-4487-a561-e9a8eb47ebe1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:35.676719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f5fd8-ee84-4432-8849-554de4e068d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:35.677910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f5fd8-ee84-4432-8849-554de4e068d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:35.678371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f5fd8-ee84-4432-8849-554de4e068d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:35.678820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f5fd8-ee84-4432-8849-554de4e068d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:35.679840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f5fd8-ee84-4432-8849-554de4e068d5 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=266555accbbd443fa51c26734d5a2f3b) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:35.680328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f5fd8-ee84-4432-8849-554de4e068d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:35.682372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f5fd8-ee84-4432-8849-554de4e068d5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:35.691054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 420/850] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:35 2022] GET /identity/v3/role_assignments?user.id=266555accbbd443fa51c26734d5a2f3b&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:37.309759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd845e9-4831-4ee2-ba9c-6d2cad21567c None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:37.311293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd845e9-4831-4ee2-ba9c-6d2cad21567c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:37.312072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd845e9-4831-4ee2-ba9c-6d2cad21567c None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:37.316203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 431/851] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:37.321485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4ccc3-77d7-4b04-8872-96afd9d8ccfa None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:37.322220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4ccc3-77d7-4b04-8872-96afd9d8ccfa None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:37.322220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4ccc3-77d7-4b04-8872-96afd9d8ccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:37.342091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c9e4ccc3-77d7-4b04-8872-96afd9d8ccfa None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:37.343323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c9e4ccc3-77d7-4b04-8872-96afd9d8ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:37.351904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 421/852] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:37 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:37.376179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd845e9-4831-4ee2-ba9c-6d2cad21567c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:37.391066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd845e9-4831-4ee2-ba9c-6d2cad21567c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:37.395864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7ec3-2c1a-4c69-9a0e-7e88e766b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:37.396575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7ec3-2c1a-4c69-9a0e-7e88e766b462 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:37.396863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7ec3-2c1a-4c69-9a0e-7e88e766b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:37.397176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7ec3-2c1a-4c69-9a0e-7e88e766b462 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:37.398068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba7ec3-2c1a-4c69-9a0e-7e88e766b462 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:37.399698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba7ec3-2c1a-4c69-9a0e-7e88e766b462 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:37.471312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 432/853] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:37 2022] POST /identity/v3/services => generated 269 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:37.806612 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50f25-d43f-4e34-a230-a4586a0290db None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:37.807091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50f25-d43f-4e34-a230-a4586a0290db None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:37.807424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50f25-d43f-4e34-a230-a4586a0290db None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:37.812041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 422/854] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:37.820513 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416249-9777-4e39-aa94-cd8aeaf85d90 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:37.820990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416249-9777-4e39-aa94-cd8aeaf85d90 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:37.821471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416249-9777-4e39-aa94-cd8aeaf85d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:37.851334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c5416249-9777-4e39-aa94-cd8aeaf85d90 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:37.853043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c5416249-9777-4e39-aa94-cd8aeaf85d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:37.885245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 433/855] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:37 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:37.917630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a50f25-d43f-4e34-a230-a4586a0290db None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:37.939625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a50f25-d43f-4e34-a230-a4586a0290db None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:37.946899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:37.948244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:37.948745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:37.950228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:37.969764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:37.983739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:01:37.993225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 423/856] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:37.995533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5416249-9777-4e39-aa94-cd8aeaf85d90 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.012424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5416249-9777-4e39-aa94-cd8aeaf85d90 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.019960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.021094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.021608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.022097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.023479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.024029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.027651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.040954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 434/857] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:38.050034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.068295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fe920-c420-4b6d-a0ec-6499a65624d1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.076785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.078212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.078687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.079173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.099684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.103412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.135715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:38.138467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 424/858] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:38.146885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.162869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981f159-01ce-4d7d-8cab-256ac82da615 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.168899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.170020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.170532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.170992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.171907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.172422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.174380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.188941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 435/859] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:38.196767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.208918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8a7c-0d6e-4bf5-b5ab-1f579771b713 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.216758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.216758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.216758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.216758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.227146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.229291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.244218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 18:01:38.245947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 425/860] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:38.252334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.264585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d0dc8-a1e2-4655-b91d-d08e7784ed3d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.269379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.270060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.270345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.270624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.271474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.271786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.273690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.300094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 436/861] 10.222.0.87 () {56 vars in 1156 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:38.301498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.312125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c125292-23d0-454f-bfdf-f15d1c70f8a5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.316804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.317496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.317780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.318058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.327318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.329020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.339170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 426/862] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:01:38.346432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.358994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe1cd8-b9fe-44e4-b746-4f656bb9176d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.364625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.365609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.366081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.366490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.379301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.381279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.402709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:38.409210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 437/863] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:38.410997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.421435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7949-561d-4dfd-9055-8f451d4ee47e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.427588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b6261-f595-40ab-b939-0b5383ff7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.428887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b6261-f595-40ab-b939-0b5383ff7601 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.429444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b6261-f595-40ab-b939-0b5383ff7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.429796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b6261-f595-40ab-b939-0b5383ff7601 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.430599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b6261-f595-40ab-b939-0b5383ff7601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.430911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b6261-f595-40ab-b939-0b5383ff7601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.432784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b6261-f595-40ab-b939-0b5383ff7601 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.453231 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 427/864] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:38.455546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.456748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92949703-eabe-4f0f-8d7e-60e0c4be6446 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.457038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92949703-eabe-4f0f-8d7e-60e0c4be6446 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.457357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92949703-eabe-4f0f-8d7e-60e0c4be6446 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.459285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 428/865] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:38.465781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208be10-88e5-43e6-aead-e3d521c70f1f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.466069 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208be10-88e5-43e6-aead-e3d521c70f1f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.466344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208be10-88e5-43e6-aead-e3d521c70f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.468005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565816d-92dd-42fc-baf4-43cb31206d51 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.473398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.474218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.474503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.474784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.483815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.485847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.488067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7208be10-88e5-43e6-aead-e3d521c70f1f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:38.489357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7208be10-88e5-43e6-aead-e3d521c70f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:38.501847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:38.505189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 429/867] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:38 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:38.507806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 438/867] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:38.509225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208be10-88e5-43e6-aead-e3d521c70f1f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.520296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208be10-88e5-43e6-aead-e3d521c70f1f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.524224 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.525289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.525954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.526232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.526504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.527822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.528119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.530034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.537455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdee55c-29d6-4c27-9a74-ed190513baa4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.542437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.545186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.545186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.545186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.545418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.548054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 430/868] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:38.549406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.554502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.565815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 18:01:38.567041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c3af9-90b8-47be-b7f0-bf5e5ddda00d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.568135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 439/869] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:38.576479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.582123 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.583289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.583746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.584032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.584939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=578059b701674f41b39442d2a018b489, user.id=9450573df8c6430a8271e86f15954d6c) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.585451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.587555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.588610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1008-ddc4-46ea-84ba-b147b12df784 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.595047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37aa1b-5ed6-45bc-8135-c960ee17c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.596017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37aa1b-5ed6-45bc-8135-c960ee17c935 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.596580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37aa1b-5ed6-45bc-8135-c960ee17c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.597139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37aa1b-5ed6-45bc-8135-c960ee17c935 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.598166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37aa1b-5ed6-45bc-8135-c960ee17c935 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.599158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37aa1b-5ed6-45bc-8135-c960ee17c935 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.602543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37aa1b-5ed6-45bc-8135-c960ee17c935 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.606226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 431/870] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/role_assignments?user.id=9450573df8c6430a8271e86f15954d6c&scope.project.id=578059b701674f41b39442d2a018b489&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:38.613774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 440/871] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:38.621413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:38.631652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9112-4537-4628-b706-b9b1f7ee4e47 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:38.636591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab91cf7-df39-49f7-bcd0-981cbb3aace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:38.639077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91cf7-df39-49f7-bcd0-981cbb3aace5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:38.639077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91cf7-df39-49f7-bcd0-981cbb3aace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:38.639077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab91cf7-df39-49f7-bcd0-981cbb3aace5 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:38.639440 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91cf7-df39-49f7-bcd0-981cbb3aace5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:38.639739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91cf7-df39-49f7-bcd0-981cbb3aace5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:38.641360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab91cf7-df39-49f7-bcd0-981cbb3aace5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:38.653324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 432/872] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:39.209707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517107f-c307-46a7-afc1-a2351b4cbb4c None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.210074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517107f-c307-46a7-afc1-a2351b4cbb4c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.210274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517107f-c307-46a7-afc1-a2351b4cbb4c None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.212981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 441/873] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:39.221072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a44624-1382-43a2-991b-549f209a90ae None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.224617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a44624-1382-43a2-991b-549f209a90ae None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.225049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a44624-1382-43a2-991b-549f209a90ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.244119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-53a44624-1382-43a2-991b-549f209a90ae None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:39.245385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-53a44624-1382-43a2-991b-549f209a90ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:39.253945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 433/874] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:39 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:39.284778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517107f-c307-46a7-afc1-a2351b4cbb4c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.303884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517107f-c307-46a7-afc1-a2351b4cbb4c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.310120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.311422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.311865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.312324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.329657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:39.340037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 18:01:39.342217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 442/875] 10.222.0.87 () {56 vars in 1141 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:39.348242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a44624-1382-43a2-991b-549f209a90ae None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.358843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a44624-1382-43a2-991b-549f209a90ae None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.363601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.364284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.364567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.364836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.365627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:39.365934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.367548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.377598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 434/876] 10.222.0.87 () {56 vars in 1136 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:39.383186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.394592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb8c1-e669-4af3-ac2f-78a5be6b8771 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.399487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.400354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.400708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.401134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.413698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.415610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.438700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:39.440339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 443/877] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:39.446354 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.457573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5e06e-dab5-4d07-a783-01b587bee86e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.462214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.462939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.463222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.463502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.464299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:39.465173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.467610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.482596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 435/878] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:39.488154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.498851 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26477f88-7fc8-4fbe-a857-309f6651f1d4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.503716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.504580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.504864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.505169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.513416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.515526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.531774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 18:01:39.533387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 444/879] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:39.539079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.550522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523411-5072-4b8a-80eb-44d14424e76c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.555485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.556267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.556555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.556835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.557766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:39.558073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.560028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.581605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 436/880] 10.222.0.87 () {56 vars in 1170 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:39.587311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.598217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5e7f0-8961-4f0d-89cb-d58d090b89d4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.603056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.603714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.604049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.604315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.613933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.615721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.626191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 445/881] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:01:39.631863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.643108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4a7e4-7a74-47bf-aedb-9b750fda1936 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.648171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.649164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.649410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.649733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.662866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.664819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.685459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:39.687133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 437/882] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:39.692942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.703450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c237b-dc3b-49d1-811a-c5ece06a117c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.708381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.708976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.709296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.709578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.710374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:39.710680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.712404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.726422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 446/883] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:39.732963 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.745476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc253c-b406-4c8e-98f0-5aa1314d0a56 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.751340 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.752521 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.752946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.753298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.762339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.764543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.779815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:39.785472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 438/884] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:39.787142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.797747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3323358-4ed0-4a6a-b79d-8735152c8ab0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.803223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34ae41-d417-463d-aa18-ae727a9e8da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.803959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ae41-d417-463d-aa18-ae727a9e8da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.804243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ae41-d417-463d-aa18-ae727a9e8da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.804578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34ae41-d417-463d-aa18-ae727a9e8da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.805507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34ae41-d417-463d-aa18-ae727a9e8da0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:39.805821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34ae41-d417-463d-aa18-ae727a9e8da0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.807759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34ae41-d417-463d-aa18-ae727a9e8da0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.822530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 447/885] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:39.829410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:39.841530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e813ee-ae71-4556-bc3b-eee957885844 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:39.846640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee70139-c742-4f11-85e7-eda5f46bb7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:39.847366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70139-c742-4f11-85e7-eda5f46bb7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:39.847650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70139-c742-4f11-85e7-eda5f46bb7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:39.847980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70139-c742-4f11-85e7-eda5f46bb7e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:39.848821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee70139-c742-4f11-85e7-eda5f46bb7e0 admin admin] RBAC: Adding query filter params (role.id=f8649a021fd94bc7994f6ccc0fc0c4cd, scope.project.id=578059b701674f41b39442d2a018b489, user.id=266555accbbd443fa51c26734d5a2f3b) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:39.849200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee70139-c742-4f11-85e7-eda5f46bb7e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:39.851117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee70139-c742-4f11-85e7-eda5f46bb7e0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:39.858266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 439/886] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:39 2022] GET /identity/v3/role_assignments?user.id=266555accbbd443fa51c26734d5a2f3b&scope.project.id=578059b701674f41b39442d2a018b489&role.id=f8649a021fd94bc7994f6ccc0fc0c4cd => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:40.098250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d252f8-9e15-4ecf-9f33-0efd93af2bfa None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:40.098631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d252f8-9e15-4ecf-9f33-0efd93af2bfa None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:40.098808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d252f8-9e15-4ecf-9f33-0efd93af2bfa None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:40.100750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 448/887] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:40.106370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96752a4-8f0a-4287-8c1e-e5526c80d13f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:40.106642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96752a4-8f0a-4287-8c1e-e5526c80d13f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:40.106917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96752a4-8f0a-4287-8c1e-e5526c80d13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:40.125676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e96752a4-8f0a-4287-8c1e-e5526c80d13f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:40.126878 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e96752a4-8f0a-4287-8c1e-e5526c80d13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:40.135141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 440/888] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:40 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:40.158979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d252f8-9e15-4ecf-9f33-0efd93af2bfa None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:40.172092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d252f8-9e15-4ecf-9f33-0efd93af2bfa None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:40.178655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20147707-7942-415b-9e02-c203e59129af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:40.179611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147707-7942-415b-9e02-c203e59129af admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:40.179893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147707-7942-415b-9e02-c203e59129af admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:40.180170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20147707-7942-415b-9e02-c203e59129af admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:40.180826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20147707-7942-415b-9e02-c203e59129af admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:40.182463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20147707-7942-415b-9e02-c203e59129af admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:40.204286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-20147707-7942-415b-9e02-c203e59129af admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 18:01:40.206896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 449/889] 10.222.0.87 () {56 vars in 1153 bytes} [Wed Feb 16 18:01:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:40.213060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96752a4-8f0a-4287-8c1e-e5526c80d13f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:40.225185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96752a4-8f0a-4287-8c1e-e5526c80d13f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:40.231108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:40.231780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:40.232250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:40.232523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:40.233272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:40.233576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:40.235179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:40.240853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 441/890] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:40.248684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20147707-7942-415b-9e02-c203e59129af admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:40.260263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20147707-7942-415b-9e02-c203e59129af admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:40.267637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:40.268313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:40.268593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:40.268865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:40.269611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:40.269916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:40.271537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:40.279164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 450/891] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:40.285059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:40.300399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66bc5f-ce02-4462-b9cd-26cf4ae38d7b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:40.305589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1f68-67e8-44b3-a493-0d14af892392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:40.306641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1f68-67e8-44b3-a493-0d14af892392 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:40.307169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1f68-67e8-44b3-a493-0d14af892392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:40.307650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1f68-67e8-44b3-a493-0d14af892392 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:40.309856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1f68-67e8-44b3-a493-0d14af892392 admin admin] RBAC: Adding query filter params (interface=public, service_id=6912cd8e39a14e979df09da19baed565, region_id=RegionOne) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:40.310481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1f68-67e8-44b3-a493-0d14af892392 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:40.313535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1f68-67e8-44b3-a493-0d14af892392 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:40.319992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 442/892] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:01:40 2022] GET /identity/v3/endpoints?service_id=6912cd8e39a14e979df09da19baed565&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:40.327847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:40.339113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f0b9d-54d8-4689-a744-d411f4f810af admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:40.345693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b770849-1720-44a3-a328-8b6a6bbb2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:40.346413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b770849-1720-44a3-a328-8b6a6bbb2066 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:40.346694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b770849-1720-44a3-a328-8b6a6bbb2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:40.347018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b770849-1720-44a3-a328-8b6a6bbb2066 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:40.347701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b770849-1720-44a3-a328-8b6a6bbb2066 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:40.349500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b770849-1720-44a3-a328-8b6a6bbb2066 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:40.359308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 451/893] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:40 2022] GET /identity/v3/services => generated 1029 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:01:41.171151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ff3dc-62a1-4743-9b7a-bc29cca51314 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.171780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ff3dc-62a1-4743-9b7a-bc29cca51314 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.171780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ff3dc-62a1-4743-9b7a-bc29cca51314 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.173926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 443/894] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:41.179819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38287fd-cc36-4037-90c5-55d0b06af334 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.180610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38287fd-cc36-4037-90c5-55d0b06af334 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.181052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38287fd-cc36-4037-90c5-55d0b06af334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.201970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f38287fd-cc36-4037-90c5-55d0b06af334 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:41.203619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f38287fd-cc36-4037-90c5-55d0b06af334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:41.211960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 452/895] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:41 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:41.237012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ff3dc-62a1-4743-9b7a-bc29cca51314 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:41.251728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ff3dc-62a1-4743-9b7a-bc29cca51314 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:41.256516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5a585-5ef5-460e-b9a2-654696a4c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:41.257222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5a585-5ef5-460e-b9a2-654696a4c454 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.257504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5a585-5ef5-460e-b9a2-654696a4c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.257775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5a585-5ef5-460e-b9a2-654696a4c454 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.258511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5a585-5ef5-460e-b9a2-654696a4c454 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:41.260101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5a585-5ef5-460e-b9a2-654696a4c454 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:41.386394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 444/896] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:41 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:41.395781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f832-1db6-451b-908d-06e5aa97e566 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.396216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f832-1db6-451b-908d-06e5aa97e566 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.396416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f832-1db6-451b-908d-06e5aa97e566 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.398983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 453/897] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:41.408215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58277d57-1ef7-4a06-90be-32d288cb1ab8 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.408692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58277d57-1ef7-4a06-90be-32d288cb1ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.409179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58277d57-1ef7-4a06-90be-32d288cb1ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.435995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-58277d57-1ef7-4a06-90be-32d288cb1ab8 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:41.437264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-58277d57-1ef7-4a06-90be-32d288cb1ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:41.460172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 445/898] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:41 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:41.492465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f832-1db6-451b-908d-06e5aa97e566 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:41.508281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f832-1db6-451b-908d-06e5aa97e566 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:41.514352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:41.515543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.516036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.516455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.517357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:41.519231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:41.532201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 18:01:41.534240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 454/899] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:41.542549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58277d57-1ef7-4a06-90be-32d288cb1ab8 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:41.552491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58277d57-1ef7-4a06-90be-32d288cb1ab8 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:41.560208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0e9c-accf-41b8-b288-70c381597ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:41.561434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0e9c-accf-41b8-b288-70c381597ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.561888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0e9c-accf-41b8-b288-70c381597ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.562414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0e9c-accf-41b8-b288-70c381597ff1 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.563753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0e9c-accf-41b8-b288-70c381597ff1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:41.564285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0e9c-accf-41b8-b288-70c381597ff1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:41.567108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0e9c-accf-41b8-b288-70c381597ff1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:41.576281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 446/900] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:41.585324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:41.598640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6e87-758d-4c13-b4c3-8f6295868a47 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:41.603482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c513a9-597b-4af7-8196-77776e2a9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:41.604364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c513a9-597b-4af7-8196-77776e2a9497 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:41.604857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c513a9-597b-4af7-8196-77776e2a9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:41.606098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c513a9-597b-4af7-8196-77776e2a9497 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:41.607293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c513a9-597b-4af7-8196-77776e2a9497 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:41.607663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c513a9-597b-4af7-8196-77776e2a9497 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:41.610315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c513a9-597b-4af7-8196-77776e2a9497 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:41.618802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 455/901] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:42.336408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcac0f-d884-4017-9967-cddb806cfcd8 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.336962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcac0f-d884-4017-9967-cddb806cfcd8 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.336962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcac0f-d884-4017-9967-cddb806cfcd8 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.339040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 447/902] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:42.345121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476725b-d7b2-4c8e-bf61-a3297b520b86 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.345643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476725b-d7b2-4c8e-bf61-a3297b520b86 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.345734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476725b-d7b2-4c8e-bf61-a3297b520b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.365944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-3476725b-d7b2-4c8e-bf61-a3297b520b86 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:42.367928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3476725b-d7b2-4c8e-bf61-a3297b520b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:42.378690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 456/903] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:42 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:42.402571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcac0f-d884-4017-9967-cddb806cfcd8 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.415792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcac0f-d884-4017-9967-cddb806cfcd8 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.420593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.421665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.422129 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.422564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.435200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:42.443030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 18:01:42.444847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 448/904] 10.222.0.87 () {56 vars in 1141 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:42.453651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476725b-d7b2-4c8e-bf61-a3297b520b86 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.462001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476725b-d7b2-4c8e-bf61-a3297b520b86 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.468447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.469508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.469858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.470141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.471448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:42.471934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.474881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.487892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 457/905] 10.222.0.87 () {56 vars in 1136 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:42.493755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.505459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc67d5-4587-43d9-ac39-fad3509b4d93 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.510221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.511043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.511327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.512364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.526561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.528938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.548162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:42.549756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 449/906] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:42.556669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.567371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44501c05-787a-40a9-999f-10074f5b2b6d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.572145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.572859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.573175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.573509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.574837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:42.575156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.576972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.593135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 458/907] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:42.598928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.610063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb3d7f-3e94-4500-96ac-e7bc738ce434 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.615020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.615926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.616283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.616567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.625504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.627551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.644585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 18:01:42.646250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 450/908] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:42.652719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.664696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7783b-2e62-4be9-baf3-776add19d1a7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.671397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.672600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.673425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.674142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.675555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:42.676115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.678501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.701869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 459/909] 10.222.0.87 () {56 vars in 1170 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:42.708202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.729641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2434435-d721-4178-8d0b-84dcad66cbd0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.735715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.737016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.737662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.738142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.751374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.753771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.775452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:42.777955 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 451/910] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:42.784883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.795251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a41bc-b1ba-43bf-9e44-d286e4473794 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.800314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.801431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.801975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.802447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.803683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:42.804183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.806104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.819609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 460/911] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:42.826847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.837907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128da2a-87d6-418c-a186-3b9144326be2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.844042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.845147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.845671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.846159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.858537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.860502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.874946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:42.877501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 452/912] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:42.883179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.894591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd6bd6-066e-460f-8ac6-60ee7226da80 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.899908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bd9b2-14d5-4f34-809d-bd929e3b8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.900830 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bd9b2-14d5-4f34-809d-bd929e3b8d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.901399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bd9b2-14d5-4f34-809d-bd929e3b8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.901894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bd9b2-14d5-4f34-809d-bd929e3b8d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.903865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bd9b2-14d5-4f34-809d-bd929e3b8d8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:42.904435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bd9b2-14d5-4f34-809d-bd929e3b8d8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.906641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bd9b2-14d5-4f34-809d-bd929e3b8d8f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:42.921272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 461/913] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:42.927406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:42.939245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364124b-a08c-4290-bdb7-07868cabda99 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:42.944277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:42.945516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:42.946033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:42.946603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/266555accbbd443fa51c26734d5a2f3b/roles/f8649a021fd94bc7994f6ccc0fc0c4cd` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:42.949204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=266555accbbd443fa51c26734d5a2f3b, role_id=f8649a021fd94bc7994f6ccc0fc0c4cd)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:42.952282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:43.019120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be9a6-7c7f-4e57-8e4b-85a54faf1cde None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:43.019304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be9a6-7c7f-4e57-8e4b-85a54faf1cde None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:43.019580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be9a6-7c7f-4e57-8e4b-85a54faf1cde None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:43.021673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 462/914] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:01:43.027538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c03fe-9951-4926-920c-f1deb0cfd424 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:43.028015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c03fe-9951-4926-920c-f1deb0cfd424 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:43.028301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c03fe-9951-4926-920c-f1deb0cfd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:43.042650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 453/915] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:01:42 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/266555accbbd443fa51c26734d5a2f3b/roles/f8649a021fd94bc7994f6ccc0fc0c4cd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:01:43.049099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-260c03fe-9951-4926-920c-f1deb0cfd424 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:43.050376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-260c03fe-9951-4926-920c-f1deb0cfd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:43.128082 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 463/916] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:43 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:43.156735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:43.173218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49014b-77a3-4d31-914d-c2b38f381b6e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:43.181319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:43.182762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:43.183215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:43.183752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:43.185061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:43.188121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:43.220362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 18:01:43.221980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 454/917] 10.222.0.87 () {56 vars in 1153 bytes} [Wed Feb 16 18:01:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:43.228602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c03fe-9951-4926-920c-f1deb0cfd424 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:43.240401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c03fe-9951-4926-920c-f1deb0cfd424 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:43.247564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:43.248823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:43.249471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:43.250062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:43.251434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:43.252070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:43.254974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:43.264541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 464/918] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:43.272674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:43.287214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79557651-f96f-4525-8988-8a7a7ae4d64e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:43.296172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06a26-d165-4092-ab5e-42edd9ffda11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:43.297241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06a26-d165-4092-ab5e-42edd9ffda11 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:43.297742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06a26-d165-4092-ab5e-42edd9ffda11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:43.298223 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06a26-d165-4092-ab5e-42edd9ffda11 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:43.299155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d06a26-d165-4092-ab5e-42edd9ffda11 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:43.299658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d06a26-d165-4092-ab5e-42edd9ffda11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:43.301498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d06a26-d165-4092-ab5e-42edd9ffda11 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:43.307909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 455/919] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:43.317235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:43.335119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e79db-f874-4d80-8f72-05bbf24a1138 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:43.340676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe6cdd-56eb-46b2-9255-c8fae8122cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:43.341970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6cdd-56eb-46b2-9255-c8fae8122cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:43.342586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6cdd-56eb-46b2-9255-c8fae8122cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:43.343323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6cdd-56eb-46b2-9255-c8fae8122cc1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:43.344844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe6cdd-56eb-46b2-9255-c8fae8122cc1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:43.348003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe6cdd-56eb-46b2-9255-c8fae8122cc1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:43.491085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 465/920] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:44.055944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063bb6a-fa88-47cf-8229-fc02da9bcf79 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.056493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063bb6a-fa88-47cf-8229-fc02da9bcf79 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.056493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063bb6a-fa88-47cf-8229-fc02da9bcf79 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.059100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 456/921] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:44.065532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02144e-0065-4051-9c5b-ded97b128815 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.066257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02144e-0065-4051-9c5b-ded97b128815 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.066751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02144e-0065-4051-9c5b-ded97b128815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.086783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-3a02144e-0065-4051-9c5b-ded97b128815 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:44.088420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3a02144e-0065-4051-9c5b-ded97b128815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:44.108628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 466/922] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:44 2022] POST /identity/v3/auth/tokens => generated 1850 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:44.108835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65226-8f5d-4560-ab54-5662723b859f None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.109067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65226-8f5d-4560-ab54-5662723b859f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.109530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65226-8f5d-4560-ab54-5662723b859f None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.111744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 457/923] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:44.117526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36b3f2-45e4-426f-b137-eee8a8654862 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.117842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36b3f2-45e4-426f-b137-eee8a8654862 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.118128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36b3f2-45e4-426f-b137-eee8a8654862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.133657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65226-8f5d-4560-ab54-5662723b859f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:44.138003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6c36b3f2-45e4-426f-b137-eee8a8654862 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:44.139206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6c36b3f2-45e4-426f-b137-eee8a8654862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:44.147593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65226-8f5d-4560-ab54-5662723b859f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:44.147895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 467/924] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:44 2022] POST /identity/v3/auth/tokens => generated 1850 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:44.157526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:44.158351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.158712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.159203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.159885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:44.162015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:44.174442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 18:01:44.176546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36b3f2-45e4-426f-b137-eee8a8654862 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:44.178066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 458/925] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:44.187693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:44.190391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36b3f2-45e4-426f-b137-eee8a8654862 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:44.195116 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:44.195799 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.196128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.196413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.197352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:44.198820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:44.207666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876df2d-9b72-419c-bdb5-09c5a7762e51 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:44.220062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:44.221172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.221643 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.222099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.223115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:44.223474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:44.226479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:44.233206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 459/926] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:44.238662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:44.249484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861be7d-7c89-400a-8a31-4d5456c5e0ef admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:44.254101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:44.254768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.255054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.255332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.256037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:44.256343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:44.257970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:44.269391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 460/927] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:44.276065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:44.287640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f270e-ec03-4c5d-8176-d0aa47e20de1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:44.293557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d922ab-d45d-4fa6-b7c2-f640f629ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:44.294328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d922ab-d45d-4fa6-b7c2-f640f629ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.294612 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d922ab-d45d-4fa6-b7c2-f640f629ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.294890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d922ab-d45d-4fa6-b7c2-f640f629ce17 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.295788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d922ab-d45d-4fa6-b7c2-f640f629ce17 admin admin] RBAC: Adding query filter params (interface=public, service_id=249ca65ccfed49bebba5d620424e106b, region_id=RegionOne) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:44.296101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d922ab-d45d-4fa6-b7c2-f640f629ce17 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:44.303225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d922ab-d45d-4fa6-b7c2-f640f629ce17 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:44.303713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 468/928] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:44 2022] POST /identity/v3/services => generated 241 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:44.309697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 461/929] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:01:44 2022] GET /identity/v3/endpoints?service_id=249ca65ccfed49bebba5d620424e106b&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:44.318119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:44.344871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb325-1f6b-4952-b8b8-7f175838fdbf admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:44.350403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d2cee-bbd4-433b-9b64-fc177506f1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:44.351287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2cee-bbd4-433b-9b64-fc177506f1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:44.351518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2cee-bbd4-433b-9b64-fc177506f1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:44.351800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d2cee-bbd4-433b-9b64-fc177506f1e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:44.352563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2cee-bbd4-433b-9b64-fc177506f1e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:44.354494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d2cee-bbd4-433b-9b64-fc177506f1e6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:44.362609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 469/930] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:44 2022] GET /identity/v3/services => generated 1497 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:01:45.680162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052e50f-e582-44c9-83c0-4fa3f61b19fc None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.680735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052e50f-e582-44c9-83c0-4fa3f61b19fc None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.680735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052e50f-e582-44c9-83c0-4fa3f61b19fc None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.683108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 462/931] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:45.688980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00dfb-7408-4c64-89ee-f94192441f39 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.689584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00dfb-7408-4c64-89ee-f94192441f39 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.689584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00dfb-7408-4c64-89ee-f94192441f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.708438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-07f00dfb-7408-4c64-89ee-f94192441f39 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:45.710016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-07f00dfb-7408-4c64-89ee-f94192441f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:45.719385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 470/932] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:45 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:45.743243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052e50f-e582-44c9-83c0-4fa3f61b19fc None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:45.755877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052e50f-e582-44c9-83c0-4fa3f61b19fc None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:45.760528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:45.761957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.762293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.762570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.774401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:45.782492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 18:01:45.784219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 463/933] 10.222.0.87 () {56 vars in 1141 bytes} [Wed Feb 16 18:01:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:45.790110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f00dfb-7408-4c64-89ee-f94192441f39 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:45.799272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f00dfb-7408-4c64-89ee-f94192441f39 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:45.804368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:45.805038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.805358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.805638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.806391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:45.806700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:45.808350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:45.818235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 471/934] 10.222.0.87 () {56 vars in 1136 bytes} [Wed Feb 16 18:01:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:45.823762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:45.835445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09e57f-48e3-4bad-9462-e4c0bbb0b9b0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:45.840659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:45.841499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.841784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.842063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.852966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:45.854819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:45.873270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:45.874929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 464/935] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:45.880548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:45.892063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dece8a-ae8a-44d8-bc1c-f5ce4d3225da admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:45.896745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:45.897456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.897742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.898018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.898750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:45.899058 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:45.900672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:45.914389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 472/936] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:45.921527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:45.932047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187afb0f-c845-4cdb-9061-b480ac886494 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:45.937547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:45.938369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.938652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.938930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.946839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:45.948893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:45.965292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 18:01:45.966854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 465/937] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:01:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:45.972496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:45.983509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad51d5-9f5e-436e-a5b8-f750caf14135 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:45.988305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f3995-051f-4acd-92ab-95810e3f0e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:45.988985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3995-051f-4acd-92ab-95810e3f0e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:45.989299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3995-051f-4acd-92ab-95810e3f0e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:45.989580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f3995-051f-4acd-92ab-95810e3f0e44 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:45.990429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3995-051f-4acd-92ab-95810e3f0e44 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:45.990742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3995-051f-4acd-92ab-95810e3f0e44 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:45.992605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f3995-051f-4acd-92ab-95810e3f0e44 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.011984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 473/938] 10.222.0.87 () {56 vars in 1170 bytes} [Wed Feb 16 18:01:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:46.018479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.030050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c643-c603-4ede-989a-7a39a5a3ff9f None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.030329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c643-c603-4ede-989a-7a39a5a3ff9f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.030611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c643-c603-4ede-989a-7a39a5a3ff9f None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.030713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477b20c-589a-476a-a702-b7a4738ef1c3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.032849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 474/939] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:46.036329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.037805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.037956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae35e1-c695-48de-95d9-b19dfaa48491 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.038112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae35e1-c695-48de-95d9-b19dfaa48491 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.038204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.038368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae35e1-c695-48de-95d9-b19dfaa48491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.038471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.050194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.052614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.057870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9cae35e1-c695-48de-95d9-b19dfaa48491 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:46.059117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9cae35e1-c695-48de-95d9-b19dfaa48491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:46.063464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 466/940] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:01:46.069141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 475/941] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:46 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:46.073545 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.082823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772bc6-817a-4437-b0fa-5a9d3a2a0bff admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.087653 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.088497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.088783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.089130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.097121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae35e1-c695-48de-95d9-b19dfaa48491 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.102351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.104486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.106445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae35e1-c695-48de-95d9-b19dfaa48491 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.111752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.112871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.113424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.113915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.114913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.116839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.125134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:46.126173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 467/942] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:46.131790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.135258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 18:01:46.142697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef0a14-9050-432e-ad9d-0565b38ae092 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.142941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 476/943] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:46.144154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.147531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.148275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.148633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.148984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.149817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:46.150208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.151880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.159850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242f7a-230c-43dd-a1c2-6f4a1e72651d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.164938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 468/944] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:46.165361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.166217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.166563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.166901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.167968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:46.168431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.170342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.170477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.180621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c206ee2-903a-4a7b-b1c1-38bd028e8e38 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.181196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 477/945] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:46.182948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.186890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.187782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.188140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.188507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.195454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2401c20-3a6b-4076-ba82-b0dae2e263e8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.196187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.198261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.208652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.209357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.209639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.209913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.210621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:46.210925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.212539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.215287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:46.217969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 478/947] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:46.221909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 469/947] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:46.223157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.239592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69b8a-e341-49e5-bb78-051e4605d5cf admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.244741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc6ee9-b271-474e-a634-f2e4aec30181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.245521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc6ee9-b271-474e-a634-f2e4aec30181 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.246434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc6ee9-b271-474e-a634-f2e4aec30181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.246723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc6ee9-b271-474e-a634-f2e4aec30181 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.247598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc6ee9-b271-474e-a634-f2e4aec30181 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:46.247913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc6ee9-b271-474e-a634-f2e4aec30181 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.250172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc6ee9-b271-474e-a634-f2e4aec30181 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.267359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 479/948] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:46.273483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:46.284625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104818e-8c07-4f1f-9397-7cb77e62e89e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:46.289971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e33ae-4446-4495-bafb-3c1fa1e02030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:46.290726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e33ae-4446-4495-bafb-3c1fa1e02030 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.291078 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e33ae-4446-4495-bafb-3c1fa1e02030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.291288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e33ae-4446-4495-bafb-3c1fa1e02030 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.292231 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e33ae-4446-4495-bafb-3c1fa1e02030 admin admin] RBAC: Adding query filter params (role.id=f8649a021fd94bc7994f6ccc0fc0c4cd, scope.project.id=578059b701674f41b39442d2a018b489, user.id=266555accbbd443fa51c26734d5a2f3b) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:46.292551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e33ae-4446-4495-bafb-3c1fa1e02030 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:46.295590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e33ae-4446-4495-bafb-3c1fa1e02030 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:46.303373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 470/949] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:46 2022] GET /identity/v3/role_assignments?user.id=266555accbbd443fa51c26734d5a2f3b&scope.project.id=578059b701674f41b39442d2a018b489&role.id=f8649a021fd94bc7994f6ccc0fc0c4cd => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:46.908001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de0d2-978b-49e0-bae4-7be3261ef987 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.908676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de0d2-978b-49e0-bae4-7be3261ef987 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.908676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de0d2-978b-49e0-bae4-7be3261ef987 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.910629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 480/950] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:46.916684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4369d1-6501-4e2a-85c7-67f0a11444f6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:46.917234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4369d1-6501-4e2a-85c7-67f0a11444f6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:46.917393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4369d1-6501-4e2a-85c7-67f0a11444f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:46.936908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-dd4369d1-6501-4e2a-85c7-67f0a11444f6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:46.938132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-dd4369d1-6501-4e2a-85c7-67f0a11444f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:46.950629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 471/951] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:46 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:47.008974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de0d2-978b-49e0-bae4-7be3261ef987 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.037761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de0d2-978b-49e0-bae4-7be3261ef987 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.049826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.050657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.050947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.051228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.051897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.053846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.074288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd638ee-af8f-450c-a571-2c98b5f16ca1 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.074571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd638ee-af8f-450c-a571-2c98b5f16ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.074844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd638ee-af8f-450c-a571-2c98b5f16ca1 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.076816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 472/952] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:47.081561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 18:01:47.083061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 481/953] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:47.089748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3a79-8555-4ca3-955b-5ef5475a5871 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.090736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3a79-8555-4ca3-955b-5ef5475a5871 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.091245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc3a79-8555-4ca3-955b-5ef5475a5871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.091591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.110868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-96dc3a79-8555-4ca3-955b-5ef5475a5871 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:47.112475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-96dc3a79-8555-4ca3-955b-5ef5475a5871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:47.116643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd570668-e1d0-4d9c-a4e9-ad99b6704bb8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.124101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.124773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.125057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.125353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.126085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:47.126487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.126723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 473/954] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:47 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:47.127956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.139390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 482/955] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:47.147011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3a79-8555-4ca3-955b-5ef5475a5871 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.159922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc3a79-8555-4ca3-955b-5ef5475a5871 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.162094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.173743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.174243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250c3dc-80e2-44fd-bf91-ed877899a434 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.174434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.174707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.175008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.175736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:47.176144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.178448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.191512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 474/956] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:47.194928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.202434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.203788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89fa8-b349-4e6c-a620-e5f762eaacce admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.205112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.206278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.207793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.208477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.209177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.209461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.209739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.210468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.210573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] RBAC: Adding query filter params (interface=public, service_id=377d06cd4c2b4b73ae9b634c73849891, region_id=RegionOne) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:47.210828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.212421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.223619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 475/957] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/endpoints?service_id=377d06cd4c2b4b73ae9b634c73849891&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:47.224576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.225655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.235122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95712-ccef-47b6-8818-2baad7be3f2a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.239733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.240409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.240692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.240965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.241661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.243251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.257616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 476/958] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/services => generated 1497 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:01:47.266191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 18:01:47.267826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 483/959] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:47.278587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.299398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b1aaf-1fc0-4959-9a5a-2c9c5a29be36 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.316260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.317760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.320199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.320755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.321915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:47.322471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.324465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.332985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 477/960] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:47.339145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.365993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217126f3-09e1-4cf5-96d8-563c135ce9b4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.372290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcb02a-4887-4492-a8e5-e403459b48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.373494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb02a-4887-4492-a8e5-e403459b48ac admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.377420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb02a-4887-4492-a8e5-e403459b48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.378037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb02a-4887-4492-a8e5-e403459b48ac admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.379060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb02a-4887-4492-a8e5-e403459b48ac admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:47.380080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb02a-4887-4492-a8e5-e403459b48ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.382843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb02a-4887-4492-a8e5-e403459b48ac admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.399484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 484/961] 10.222.0.87 () {56 vars in 1135 bytes} [Wed Feb 16 18:01:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:47.404802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:47.426444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139fc86-9522-44ae-b143-49e9f4203fc1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:47.432015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8d988-f24c-4c4e-b5ad-301cc084dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:47.433036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d988-f24c-4c4e-b5ad-301cc084dd44 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:47.434106 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d988-f24c-4c4e-b5ad-301cc084dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:47.434614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d988-f24c-4c4e-b5ad-301cc084dd44 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:47.435605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8d988-f24c-4c4e-b5ad-301cc084dd44 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:47.437536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8d988-f24c-4c4e-b5ad-301cc084dd44 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:47.579969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 478/962] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:48.780877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ad2c-7268-410a-96de-b213bc99f1c5 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:48.781460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ad2c-7268-410a-96de-b213bc99f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:48.781460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6ad2c-7268-410a-96de-b213bc99f1c5 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:48.783704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 485/963] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:48.789405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365894-a7fd-4dbd-bfb6-5958bf8eb362 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:48.789885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365894-a7fd-4dbd-bfb6-5958bf8eb362 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:48.790047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365894-a7fd-4dbd-bfb6-5958bf8eb362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:48.808927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7e365894-a7fd-4dbd-bfb6-5958bf8eb362 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:48.810372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7e365894-a7fd-4dbd-bfb6-5958bf8eb362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:48.833191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 479/964] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:48 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:48.852271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ad2c-7268-410a-96de-b213bc99f1c5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:48.865579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6ad2c-7268-410a-96de-b213bc99f1c5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:48.871135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:48.872308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:48.872764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:48.873232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:48.874168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:48.875916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:48.976675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad429-9d5d-40ce-85ad-e1c55c7f07e7 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:48.976997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad429-9d5d-40ce-85ad-e1c55c7f07e7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:48.977317 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdad429-9d5d-40ce-85ad-e1c55c7f07e7 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:48.979667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 480/965] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:48.985481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397d91-cba4-497e-87ba-c6cd1e6710bd None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:48.985926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397d91-cba4-497e-87ba-c6cd1e6710bd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:48.986152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397d91-cba4-497e-87ba-c6cd1e6710bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:48.994156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 486/966] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:48 2022] POST /identity/v3/services => generated 242 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:49.009036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-9b397d91-cba4-497e-87ba-c6cd1e6710bd None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:49.010375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9b397d91-cba4-497e-87ba-c6cd1e6710bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:49.031468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 481/967] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:48 2022] POST /identity/v3/auth/tokens => generated 2234 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:49.057837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:49.069935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d931c9-060d-4c9a-b423-351352111773 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:49.075680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:49.076474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:49.076762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:49.077037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:49.077755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:49.079517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:49.092639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 18:01:49.094440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 487/968] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Feb 16 18:01:49 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:49.100469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397d91-cba4-497e-87ba-c6cd1e6710bd None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:49.112265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397d91-cba4-497e-87ba-c6cd1e6710bd None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:49.117515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a5ff-6028-4320-8754-3226a15dd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:49.118651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a5ff-6028-4320-8754-3226a15dd7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:49.119136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a5ff-6028-4320-8754-3226a15dd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:49.119633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a5ff-6028-4320-8754-3226a15dd7ca admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:49.120564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7a5ff-6028-4320-8754-3226a15dd7ca admin admin] RBAC: Adding query filter params (name=image) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:49.121150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7a5ff-6028-4320-8754-3226a15dd7ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:49.123382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7a5ff-6028-4320-8754-3226a15dd7ca admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:49.129606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 482/969] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:49.135796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:49.146860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea2439-4282-4f7e-a73d-ccd73b44a71f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:49.151887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbdca1-741d-4bfb-bda7-536f58c56f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:49.153564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdca1-741d-4bfb-bda7-536f58c56f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:49.153564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdca1-741d-4bfb-bda7-536f58c56f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:49.153756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbdca1-741d-4bfb-bda7-536f58c56f5c admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:49.154615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbdca1-741d-4bfb-bda7-536f58c56f5c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:49.154927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbdca1-741d-4bfb-bda7-536f58c56f5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:49.156768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbdca1-741d-4bfb-bda7-536f58c56f5c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:49.163014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 488/970] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:49.856216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2353-a6b6-4e99-92e5-4746e12f66fd None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:49.856934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2353-a6b6-4e99-92e5-4746e12f66fd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:49.856934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2353-a6b6-4e99-92e5-4746e12f66fd None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:49.858935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 483/971] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:49.864746 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897dd5-0768-4cff-93fe-c7bee3d8eec5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:49.865795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897dd5-0768-4cff-93fe-c7bee3d8eec5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:49.866356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897dd5-0768-4cff-93fe-c7bee3d8eec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:49.886377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-79897dd5-0768-4cff-93fe-c7bee3d8eec5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:49.888847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-79897dd5-0768-4cff-93fe-c7bee3d8eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:49.899864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 489/972] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:49 2022] POST /identity/v3/auth/tokens => generated 2234 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:49.923951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2353-a6b6-4e99-92e5-4746e12f66fd None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:49.937918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2353-a6b6-4e99-92e5-4746e12f66fd None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:49.943100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:49.944243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:49.944732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:49.945246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:49.946127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:49.947913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:49.961106 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 18:01:49.963001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 484/973] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:49.969603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897dd5-0768-4cff-93fe-c7bee3d8eec5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:49.979123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897dd5-0768-4cff-93fe-c7bee3d8eec5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:49.984661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:49.985710 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:49.986252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:49.986731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:49.987677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:49.988191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:49.990253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:49.996938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 490/974] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:50.003112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:50.014072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3c1a-aecd-486e-94ee-b0273481933b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:50.019186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e9d24-dca6-44f2-aa5e-0e833bb2731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:50.020189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e9d24-dca6-44f2-aa5e-0e833bb2731a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:50.020700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e9d24-dca6-44f2-aa5e-0e833bb2731a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:50.021245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e9d24-dca6-44f2-aa5e-0e833bb2731a admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:50.022180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e9d24-dca6-44f2-aa5e-0e833bb2731a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:50.022738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e9d24-dca6-44f2-aa5e-0e833bb2731a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:50.024588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e9d24-dca6-44f2-aa5e-0e833bb2731a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:50.031446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 485/975] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:50.037558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:50.049032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730ed2c-7818-405e-8779-94e92bccdc03 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:50.054233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb50b3-207c-4c5b-bf5b-9b2ae2c6d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:50.054894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb50b3-207c-4c5b-bf5b-9b2ae2c6d2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:50.055177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb50b3-207c-4c5b-bf5b-9b2ae2c6d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:50.055454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb50b3-207c-4c5b-bf5b-9b2ae2c6d2c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:50.056211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb50b3-207c-4c5b-bf5b-9b2ae2c6d2c7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:50.057863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb50b3-207c-4c5b-bf5b-9b2ae2c6d2c7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:50.140192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 491/976] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:50.154109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558dcf1-11f6-478f-874e-028d4d381056 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:50.154427 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558dcf1-11f6-478f-874e-028d4d381056 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:50.154792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558dcf1-11f6-478f-874e-028d4d381056 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:50.157147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 486/977] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:50.163462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46f8cf-ab1c-4f1c-8f36-47684e70ab32 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:50.163789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46f8cf-ab1c-4f1c-8f36-47684e70ab32 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:50.164032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46f8cf-ab1c-4f1c-8f36-47684e70ab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:50.184971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2c46f8cf-ab1c-4f1c-8f36-47684e70ab32 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:50.189119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2c46f8cf-ab1c-4f1c-8f36-47684e70ab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:50.208747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 492/978] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:50 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:50.241008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558dcf1-11f6-478f-874e-028d4d381056 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:50.254662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558dcf1-11f6-478f-874e-028d4d381056 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:50.259779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:50.260823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:50.261872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:50.262338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:50.263362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:50.265533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:50.267239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.common [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 16 18:01:50.342553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.sql.core [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 16 18:01:50.342553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 16 18:01:50.342553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [parameters: {'id': 'e0151387b90945239b8d48cf8f6fda27', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 16 18:01:50.342553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 18:01:50.359650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0151387b90945239b8d48cf8f6fda27.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0151387b90945239b8d48cf8f6fda27. Feb 16 18:01:50.361356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 487/979] 10.222.0.87 () {60 vars in 1161 bytes} [Wed Feb 16 18:01:50 2022] POST /identity/v3/projects => generated 262 bytes in 121 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:50.367571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46f8cf-ab1c-4f1c-8f36-47684e70ab32 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:50.378719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46f8cf-ab1c-4f1c-8f36-47684e70ab32 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:50.385875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545c3f8-78c1-4368-a85e-497944d821f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:50.387451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545c3f8-78c1-4368-a85e-497944d821f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:50.387786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545c3f8-78c1-4368-a85e-497944d821f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:50.388440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545c3f8-78c1-4368-a85e-497944d821f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:50.403418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545c3f8-78c1-4368-a85e-497944d821f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:50.403418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545c3f8-78c1-4368-a85e-497944d821f4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:50.412916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-3545c3f8-78c1-4368-a85e-497944d821f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:50.414607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 493/980] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:50.421610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:50.434614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c1dc1-ccda-40cb-b379-3d6d5c632f34 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:50.439687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787ad5d-f449-48aa-b890-7c1103a420c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:50.440507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ad5d-f449-48aa-b890-7c1103a420c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:50.440800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ad5d-f449-48aa-b890-7c1103a420c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:50.441142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787ad5d-f449-48aa-b890-7c1103a420c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:50.441999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787ad5d-f449-48aa-b890-7c1103a420c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:50.442367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787ad5d-f449-48aa-b890-7c1103a420c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:50.444710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787ad5d-f449-48aa-b890-7c1103a420c4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:50.469825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 488/981] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:51.702534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e40bf-8663-4d4d-8731-b6c93320eab8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:51.703352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e40bf-8663-4d4d-8731-b6c93320eab8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:51.703352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e40bf-8663-4d4d-8731-b6c93320eab8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:51.705370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 494/982] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:51.711642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1e1f-6067-43e9-a143-8c769d907f72 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:51.712148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1e1f-6067-43e9-a143-8c769d907f72 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:51.712220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a1e1f-6067-43e9-a143-8c769d907f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:51.732795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-569a1e1f-6067-43e9-a143-8c769d907f72 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:51.734444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-569a1e1f-6067-43e9-a143-8c769d907f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:51.749227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 489/983] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:51 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:51.768493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e40bf-8663-4d4d-8731-b6c93320eab8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:51.782367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e40bf-8663-4d4d-8731-b6c93320eab8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:51.787198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:51.787891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:51.788180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:51.788460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:51.789371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:51.791054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:51.830357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf35afa-1d01-4da6-8eb7-9d197ec98759 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:51.830777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf35afa-1d01-4da6-8eb7-9d197ec98759 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:51.831184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf35afa-1d01-4da6-8eb7-9d197ec98759 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:51.834101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 490/984] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:51.842471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc7a1-785a-4130-998b-265fcfc2a1ac None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:51.843235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc7a1-785a-4130-998b-265fcfc2a1ac None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:51.843880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc7a1-785a-4130-998b-265fcfc2a1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:51.869289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c1edc7a1-785a-4130-998b-265fcfc2a1ac None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:51.871732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c1edc7a1-785a-4130-998b-265fcfc2a1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:51.882179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 491/985] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:51 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:51.907019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 495/986] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:51 2022] POST /identity/v3/services => generated 242 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:51.908044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc7a1-785a-4130-998b-265fcfc2a1ac None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:51.920480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc7a1-785a-4130-998b-265fcfc2a1ac None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:51.940514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:51.941875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:51.942397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:51.942888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:51.943880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:51.945931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:51.960445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 18:01:51.962472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 492/987] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:51.971077 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:51.989573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977e01-2427-4f2b-b4fe-9d0753b98355 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:51.994482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:51.995174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:51.995460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:51.995801 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:51.996845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:51.996977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:51.998966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:52.005514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 496/988] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:01:52.013539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:52.028696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156ffad-6e61-4195-b554-b4dd786de108 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:52.034107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:52.034783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:52.035063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:52.035334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:52.036043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:52.036344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:52.038033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:52.045509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 493/989] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:52.051768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:52.066698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0377d063-fb06-481f-9f5b-dadec96c9697 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:52.073685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0486abc-2f09-4762-a4b4-9b3bd871dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:52.074795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486abc-2f09-4762-a4b4-9b3bd871dee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:52.075091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486abc-2f09-4762-a4b4-9b3bd871dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:52.075530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486abc-2f09-4762-a4b4-9b3bd871dee0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:52.076856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0486abc-2f09-4762-a4b4-9b3bd871dee0 admin admin] RBAC: Adding query filter params (interface=public, service_id=6e73205a3782434eaaf1f6b68f31dcaa, region_id=RegionOne) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:52.077369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0486abc-2f09-4762-a4b4-9b3bd871dee0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:52.080010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0486abc-2f09-4762-a4b4-9b3bd871dee0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:52.088950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 497/990] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:01:52 2022] GET /identity/v3/endpoints?service_id=6e73205a3782434eaaf1f6b68f31dcaa&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:52.095684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:52.107400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092742e-3dd2-4cb1-a3fb-7459bd74a29f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:52.112951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91653-fc36-403f-a22e-307f73b5a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:52.114092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91653-fc36-403f-a22e-307f73b5a08f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:52.114608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91653-fc36-403f-a22e-307f73b5a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:52.115144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91653-fc36-403f-a22e-307f73b5a08f admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:52.116060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91653-fc36-403f-a22e-307f73b5a08f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:52.118261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91653-fc36-403f-a22e-307f73b5a08f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:52.132422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 494/991] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:52 2022] GET /identity/v3/services => generated 1957 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:01:52.888197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21168a9-9f59-40cd-9dad-7f9732797b8a None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:52.888869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21168a9-9f59-40cd-9dad-7f9732797b8a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:52.888869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21168a9-9f59-40cd-9dad-7f9732797b8a None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:52.888869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 498/992] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:52.900202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e6144-ba24-4f7b-996e-f6c2a8f5d477 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:52.901212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e6144-ba24-4f7b-996e-f6c2a8f5d477 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:52.901728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e6144-ba24-4f7b-996e-f6c2a8f5d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:52.926138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-977e6144-ba24-4f7b-996e-f6c2a8f5d477 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:52.927769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-977e6144-ba24-4f7b-996e-f6c2a8f5d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:52.939971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 495/993] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:52 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:52.963946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21168a9-9f59-40cd-9dad-7f9732797b8a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:52.978275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21168a9-9f59-40cd-9dad-7f9732797b8a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:52.984264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:52.985524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:52.986017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:52.986499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:52.987376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:52.989304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.002398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 18:01:53.004340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 499/994] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:53.010780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e6144-ba24-4f7b-996e-f6c2a8f5d477 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:53.022259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e6144-ba24-4f7b-996e-f6c2a8f5d477 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:53.028286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b3081-0f9e-4fa1-810a-a1c819d56863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:53.029196 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3081-0f9e-4fa1-810a-a1c819d56863 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.029480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3081-0f9e-4fa1-810a-a1c819d56863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.029925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b3081-0f9e-4fa1-810a-a1c819d56863 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.030665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b3081-0f9e-4fa1-810a-a1c819d56863 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:53.030968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b3081-0f9e-4fa1-810a-a1c819d56863 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:53.032738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b3081-0f9e-4fa1-810a-a1c819d56863 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.041408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 496/995] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:53.047976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:53.059483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9009e70-128a-43ed-8b21-ae075e3ca127 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:53.061931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa8b23-1a05-4692-ba05-7cbab0bd8cae None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.062229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa8b23-1a05-4692-ba05-7cbab0bd8cae None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.062517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa8b23-1a05-4692-ba05-7cbab0bd8cae None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.064751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 497/996] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:53.065845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:53.066738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.067180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.067605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.068836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:53.069191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:53.070328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f0e9a-4841-4394-932f-6fdc4a9fc945 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.070841 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f0e9a-4841-4394-932f-6fdc4a9fc945 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.070947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.071324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f0e9a-4841-4394-932f-6fdc4a9fc945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.078132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 500/997] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:53.084232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:53.095302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75086-549e-4a97-883d-d2ddae698bee admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:53.096597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-106f0e9a-4841-4394-932f-6fdc4a9fc945 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:53.098082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-106f0e9a-4841-4394-932f-6fdc4a9fc945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:53.100371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:53.101220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.101655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.102037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.104465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] RBAC: Adding query filter params (interface=admin, service_id=377d06cd4c2b4b73ae9b634c73849891, region_id=RegionOne) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:53.104465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:53.105357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.111711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 501/998] 10.222.0.87 () {56 vars in 1270 bytes} [Wed Feb 16 18:01:53 2022] GET /identity/v3/endpoints?service_id=377d06cd4c2b4b73ae9b634c73849891&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:53.112801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 498/999] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:53 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:53.121144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:53.128368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d6ed-7d90-44e9-aa01-5e030dd240a6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:53.133622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:53.134499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.134905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.135309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.136112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:53.138956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.140535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f0e9a-4841-4394-932f-6fdc4a9fc945 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:53.147000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 502/1000] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:53 2022] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:01:53.153050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f0e9a-4841-4394-932f-6fdc4a9fc945 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:53.158870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:53.160018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.160634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.161188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.162189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:53.164842 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.221575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.sql.core [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 16 18:01:53.221575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 16 18:01:53.221575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [parameters: {'user_id': '438455c8b3334954a62414338ab22a02', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 16 18:01:53.221575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 18:01:53.232712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 16 18:01:53.235418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 499/1001] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:01:53 2022] POST /identity/v3/users => generated 160 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:01:53.241414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:53.255204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972de91-4795-4f1e-b400-a69a65934cad admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:53.263853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90bfd3-7778-4578-8299-a1c729a16a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:53.265222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bfd3-7778-4578-8299-a1c729a16a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.265673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bfd3-7778-4578-8299-a1c729a16a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.266096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bfd3-7778-4578-8299-a1c729a16a25 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.279664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90bfd3-7778-4578-8299-a1c729a16a25 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:53.282070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90bfd3-7778-4578-8299-a1c729a16a25 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.298768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-fc90bfd3-7778-4578-8299-a1c729a16a25 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 18:01:53.300925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 503/1002] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:01:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:53.308041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:53.319982 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95394f-c0c8-4272-bcf6-84b361c3123d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:53.326900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c48dd-7f62-4e5c-b29c-dafc3990c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:53.328304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c48dd-7f62-4e5c-b29c-dafc3990c0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:53.328727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c48dd-7f62-4e5c-b29c-dafc3990c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:53.329164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c48dd-7f62-4e5c-b29c-dafc3990c0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:53.330219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c48dd-7f62-4e5c-b29c-dafc3990c0e5 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:53.330529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c48dd-7f62-4e5c-b29c-dafc3990c0e5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:53.332908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c48dd-7f62-4e5c-b29c-dafc3990c0e5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:53.391060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 500/1003] 10.222.0.87 () {56 vars in 1122 bytes} [Wed Feb 16 18:01:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:54.534523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521f3fb-6a8b-4e99-a192-4d9006821264 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.535039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521f3fb-6a8b-4e99-a192-4d9006821264 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.535039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521f3fb-6a8b-4e99-a192-4d9006821264 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.537004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 504/1004] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:54.542672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182603-efed-4975-8b73-4ec025b10461 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.543686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182603-efed-4975-8b73-4ec025b10461 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.543762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182603-efed-4975-8b73-4ec025b10461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.563222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-10182603-efed-4975-8b73-4ec025b10461 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:54.564802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-10182603-efed-4975-8b73-4ec025b10461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:54.573214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 501/1005] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:54 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:54.597563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521f3fb-6a8b-4e99-a192-4d9006821264 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.611684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521f3fb-6a8b-4e99-a192-4d9006821264 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.616504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.617413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.617709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.617980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.618638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.620286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.632274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 18:01:54.633883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 505/1006] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:54.640445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182603-efed-4975-8b73-4ec025b10461 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.649913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182603-efed-4975-8b73-4ec025b10461 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.655806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.656501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.656786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.657063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.657861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:54.658169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.659832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.665879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 502/1007] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:54.671536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.682135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71b9c4-1814-40ab-a874-5e74211c7a28 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.687068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6cb9-9335-4d1b-b0ae-9bca1573aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.687753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6cb9-9335-4d1b-b0ae-9bca1573aceb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.688038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6cb9-9335-4d1b-b0ae-9bca1573aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.688316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6cb9-9335-4d1b-b0ae-9bca1573aceb admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.689031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6cb9-9335-4d1b-b0ae-9bca1573aceb admin admin] RBAC: Adding query filter params (type=image) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:54.689363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6cb9-9335-4d1b-b0ae-9bca1573aceb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.690991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf6cb9-9335-4d1b-b0ae-9bca1573aceb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.696991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 506/1008] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:54.703560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.705562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fcfe-ef70-4f28-b317-8218cdf4bc9d None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.705861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fcfe-ef70-4f28-b317-8218cdf4bc9d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.706143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fcfe-ef70-4f28-b317-8218cdf4bc9d None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.708094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 507/1009] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:54.713884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61804d6e-de5a-4e5c-aded-628421c9c143 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.714116 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ca1f6-d8b7-4f1d-aabc-ed0316592bbb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.714255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ca1f6-d8b7-4f1d-aabc-ed0316592bbb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.714700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ca1f6-d8b7-4f1d-aabc-ed0316592bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.719578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.720489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.720966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.721420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.722390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] RBAC: Adding query filter params (interface=public, service_id=fa38662ef8394a7c9cc0a8082afa9159, region_id=RegionOne) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:54.722868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.724644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.735032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 503/1010] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/endpoints?service_id=fa38662ef8394a7c9cc0a8082afa9159&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:54.735824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-833ca1f6-d8b7-4f1d-aabc-ed0316592bbb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:54.736460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.737115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-833ca1f6-d8b7-4f1d-aabc-ed0316592bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:54.745341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 508/1011] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:54 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:54.747501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2bbd-2c34-4c23-ab33-3c26f8576fbf admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.753683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.754376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.754666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.754948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.755681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.757344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.773211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 504/1012] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:01:54.773412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ca1f6-d8b7-4f1d-aabc-ed0316592bbb None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.784365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ca1f6-d8b7-4f1d-aabc-ed0316592bbb None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.789544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.790276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.790555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.790827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.791505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.793975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.807075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 18:01:54.809434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 509/1013] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:54.816266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.832775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ceb3c-cd99-48f4-8cca-88eb92bfecbb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.837962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.838668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.838952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.839231 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.840646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:54.840952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.842656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.848886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 505/1014] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:54.855665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.873194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381ce16-2c6a-4f52-a3b2-679adcd02445 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.879638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e251e-5337-44c9-8277-35d2b68cd262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.880350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e251e-5337-44c9-8277-35d2b68cd262 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.880635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e251e-5337-44c9-8277-35d2b68cd262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.880913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e251e-5337-44c9-8277-35d2b68cd262 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.881695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e251e-5337-44c9-8277-35d2b68cd262 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:54.882030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e251e-5337-44c9-8277-35d2b68cd262 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.883673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e251e-5337-44c9-8277-35d2b68cd262 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:54.896583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 510/1015] 10.222.0.87 () {56 vars in 1133 bytes} [Wed Feb 16 18:01:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:54.898228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:54.909533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25b0b3-9d34-442e-b981-cffd32097a42 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:54.914668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d350d6-bbbb-4c96-8d1d-4741970ed079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:54.915361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d350d6-bbbb-4c96-8d1d-4741970ed079 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:54.915635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d350d6-bbbb-4c96-8d1d-4741970ed079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:54.915922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d350d6-bbbb-4c96-8d1d-4741970ed079 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:54.916728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d350d6-bbbb-4c96-8d1d-4741970ed079 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:54.918969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d350d6-bbbb-4c96-8d1d-4741970ed079 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:55.022104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 506/1016] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:01:55.772510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330a22-2b1a-4f26-b9e3-4ba12821e08a None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:55.773045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330a22-2b1a-4f26-b9e3-4ba12821e08a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:55.773045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87330a22-2b1a-4f26-b9e3-4ba12821e08a None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:55.774992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 511/1017] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:55.780897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad828f0-6196-4f55-a306-7fc4e57fee18 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:55.781444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad828f0-6196-4f55-a306-7fc4e57fee18 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:55.781517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad828f0-6196-4f55-a306-7fc4e57fee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:55.805911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4ad828f0-6196-4f55-a306-7fc4e57fee18 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:55.807144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4ad828f0-6196-4f55-a306-7fc4e57fee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:55.826600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 507/1018] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:55 2022] POST /identity/v3/auth/tokens => generated 2675 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:01:55.850030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87330a22-2b1a-4f26-b9e3-4ba12821e08a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:55.863077 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87330a22-2b1a-4f26-b9e3-4ba12821e08a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:55.867787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:55.868603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:55.868880 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:55.869187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:55.869848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:55.871990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:55.884210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 18:01:55.885678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 512/1019] 10.222.0.87 () {56 vars in 1147 bytes} [Wed Feb 16 18:01:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:55.892421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad828f0-6196-4f55-a306-7fc4e57fee18 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:55.901557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad828f0-6196-4f55-a306-7fc4e57fee18 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:55.906428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:55.907101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:55.907382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:55.907664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:55.908376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:55.908680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:55.910359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:55.926311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 508/1020] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:55.932192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:55.944146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e424-e03e-4b86-9e82-825e9fdb1705 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:55.949661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b355604-f1f0-4646-a1aa-56c49ae83acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:55.950219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355604-f1f0-4646-a1aa-56c49ae83acf admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:55.950499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355604-f1f0-4646-a1aa-56c49ae83acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:55.950770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b355604-f1f0-4646-a1aa-56c49ae83acf admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:55.951467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b355604-f1f0-4646-a1aa-56c49ae83acf admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:55.951768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b355604-f1f0-4646-a1aa-56c49ae83acf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:55.954859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b355604-f1f0-4646-a1aa-56c49ae83acf admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:55.961587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 513/1021] 10.222.0.87 () {56 vars in 1143 bytes} [Wed Feb 16 18:01:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:55.967776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:55.982091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fab9d-caa8-474c-ad6a-42e2a3c00739 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:55.988926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46585d-f484-4227-90e3-c0ada59b9449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:55.989719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46585d-f484-4227-90e3-c0ada59b9449 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:55.990067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46585d-f484-4227-90e3-c0ada59b9449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:55.990350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46585d-f484-4227-90e3-c0ada59b9449 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:55.991105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46585d-f484-4227-90e3-c0ada59b9449 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:55.992706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46585d-f484-4227-90e3-c0ada59b9449 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:56.083827 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 509/1022] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:57.286044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fb64-e40d-41c1-a842-790eec34f4af None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.286563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fb64-e40d-41c1-a842-790eec34f4af None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.286638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fb64-e40d-41c1-a842-790eec34f4af None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.288381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 514/1023] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:57.295148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a06a0-cb8c-4beb-a4b4-b3a5eeb293c6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.295650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a06a0-cb8c-4beb-a4b4-b3a5eeb293c6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.295734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a06a0-cb8c-4beb-a4b4-b3a5eeb293c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.314856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-747a06a0-cb8c-4beb-a4b4-b3a5eeb293c6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:57.316083 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-747a06a0-cb8c-4beb-a4b4-b3a5eeb293c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:57.335516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 510/1024] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:57 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:57.359774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fb64-e40d-41c1-a842-790eec34f4af None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:57.372486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fb64-e40d-41c1-a842-790eec34f4af None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:57.376761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:57.377623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.377905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.378178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] PATH_INFO: `/v3/services/image` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.378821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:57.380399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:57.392277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 18:01:57.397259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 515/1025] 10.222.0.87 () {56 vars in 1126 bytes} [Wed Feb 16 18:01:57 2022] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:57.399751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a06a0-cb8c-4beb-a4b4-b3a5eeb293c6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:57.415896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a06a0-cb8c-4beb-a4b4-b3a5eeb293c6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:57.421053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:57.421821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.422089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.422371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.423099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:57.423404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:57.425345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:57.434010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 511/1026] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:57.438689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:57.448822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aeb86-f289-4e57-969d-962f2b2547da admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:57.454078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b20b95-ae71-4051-8c5c-471da111af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:57.454743 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20b95-ae71-4051-8c5c-471da111af96 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.455027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20b95-ae71-4051-8c5c-471da111af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.455303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20b95-ae71-4051-8c5c-471da111af96 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.456013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b20b95-ae71-4051-8c5c-471da111af96 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:57.456318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b20b95-ae71-4051-8c5c-471da111af96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:57.457955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b20b95-ae71-4051-8c5c-471da111af96 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:57.464322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 516/1027] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:57.469427 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:57.479453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c3c51-d592-44fe-a97e-76899c6f0a28 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:57.485271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91ba2-960a-4813-9b56-86dd4f01d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:57.486010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91ba2-960a-4813-9b56-86dd4f01d381 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.486388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91ba2-960a-4813-9b56-86dd4f01d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.486742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91ba2-960a-4813-9b56-86dd4f01d381 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.487574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91ba2-960a-4813-9b56-86dd4f01d381 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:57.489310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91ba2-960a-4813-9b56-86dd4f01d381 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:57.568546 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 512/1028] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:01:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:01:57.790334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a29ac-a4cd-4204-8287-0b413964ab82 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.790542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a29ac-a4cd-4204-8287-0b413964ab82 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.790822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a29ac-a4cd-4204-8287-0b413964ab82 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.794068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 517/1029] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:57.799460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2c72-074c-4ecc-bacb-6d2c4156cf49 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.799753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2c72-074c-4ecc-bacb-6d2c4156cf49 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.800037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2c72-074c-4ecc-bacb-6d2c4156cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.819253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e6fe2c72-074c-4ecc-bacb-6d2c4156cf49 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:57.820468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e6fe2c72-074c-4ecc-bacb-6d2c4156cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:57.839397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 513/1030] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:57.864707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a29ac-a4cd-4204-8287-0b413964ab82 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:57.878158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a29ac-a4cd-4204-8287-0b413964ab82 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:57.882674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:57.883490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.883778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.884057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.895686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:01:57.903571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 18:01:57.905007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 518/1031] 10.222.0.87 () {56 vars in 1141 bytes} [Wed Feb 16 18:01:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:57.910858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe2c72-074c-4ecc-bacb-6d2c4156cf49 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:57.921435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe2c72-074c-4ecc-bacb-6d2c4156cf49 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:57.926330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:57.927019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.927305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.927583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.928586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:57.928893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:57.930551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:57.945314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 514/1032] 10.222.0.87 () {56 vars in 1136 bytes} [Wed Feb 16 18:01:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:57.946659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:57.956757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea307a-3214-46ad-8b51-97608d6c92b0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:57.961443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:57.962241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:57.962526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:57.962801 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:57.975418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:57.977317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:57.996005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:57.997513 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 519/1033] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:58.003208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.013767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb8f28-23db-4065-9935-b8ef05402ee5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.018699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.019458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.019818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.020169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.020973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:58.021376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.023217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.041196 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 515/1034] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:58.043568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.055516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e268c-6ded-4926-ac1c-2be382d44ed2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.060501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.061320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.061650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.061875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.069760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.071939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.087982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:01:58.090027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 520/1035] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:58.096023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.106936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23371e25-c53d-4708-9aa9-97e7f6eba9e1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.111586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.112263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.112547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.112821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.113697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:58.114005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.115868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.134430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 516/1036] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:58.140421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.151129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6d57-fda2-47e8-9604-2e36ef7eedc9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.156818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.157600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.157888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.158294 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.167089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.170072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.185124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 521/1037] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:01:58.187730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.200842 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df74bf7-28bf-4a34-889f-c38864bcd1bd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.205936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.206629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.206920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.207201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.224810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.224810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.243986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:01:58.245696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 517/1038] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:58.251457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.260778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf7e6b-c6ac-4fa7-95e3-c6df7ff49e8d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.267683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.268239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.268528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.268809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.269580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:58.269932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.271544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.285174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 522/1039] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:58.290944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.302367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c939ba-297a-4473-9639-472e7ffc776a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.307557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.308512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.309073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.309619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.317904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.319981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.335230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:01:58.336681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 518/1040] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:01:58.343479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.353618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c23828-417a-4eff-8456-ea778cbfdb43 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.358803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ae008-feb4-4864-ab9e-381395f686bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.359557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ae008-feb4-4864-ab9e-381395f686bd admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.362316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ae008-feb4-4864-ab9e-381395f686bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.362316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ae008-feb4-4864-ab9e-381395f686bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.362316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ae008-feb4-4864-ab9e-381395f686bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:58.362316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ae008-feb4-4864-ab9e-381395f686bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.364063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ae008-feb4-4864-ab9e-381395f686bd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.383065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 523/1041] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:58.384415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.398201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b7a2-0d8f-4cbc-a1d4-3f9c28c124a2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.403921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d489d9-a203-42f1-9c3f-ea0fb114b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.404601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d489d9-a203-42f1-9c3f-ea0fb114b7be admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.404881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d489d9-a203-42f1-9c3f-ea0fb114b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.405190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d489d9-a203-42f1-9c3f-ea0fb114b7be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.406036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d489d9-a203-42f1-9c3f-ea0fb114b7be admin admin] RBAC: Adding query filter params (role.id=f8649a021fd94bc7994f6ccc0fc0c4cd, scope.project.id=578059b701674f41b39442d2a018b489, user.id=28dfb9c84dda4d6799a490a009e867df) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:01:58.406351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d489d9-a203-42f1-9c3f-ea0fb114b7be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.408237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d489d9-a203-42f1-9c3f-ea0fb114b7be admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.414790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 519/1042] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/role_assignments?user.id=28dfb9c84dda4d6799a490a009e867df&scope.project.id=578059b701674f41b39442d2a018b489&role.id=f8649a021fd94bc7994f6ccc0fc0c4cd => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:58.550615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0dec-a565-4bf1-a572-6ef3265d1ed8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.550952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0dec-a565-4bf1-a572-6ef3265d1ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.551173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a0dec-a565-4bf1-a572-6ef3265d1ed8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.553577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 524/1043] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:01:58.559835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336326f6-d469-4e6e-9963-7c8f24711a69 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.560144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336326f6-d469-4e6e-9963-7c8f24711a69 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.560478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336326f6-d469-4e6e-9963-7c8f24711a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.579289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-336326f6-d469-4e6e-9963-7c8f24711a69 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:01:58.580561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-336326f6-d469-4e6e-9963-7c8f24711a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:01:58.588780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 520/1044] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:01:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:01:58.612829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a0dec-a565-4bf1-a572-6ef3265d1ed8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.626419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a0dec-a565-4bf1-a572-6ef3265d1ed8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.630900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a090-a8dc-48da-a0f0-25afdd1a6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.631688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a090-a8dc-48da-a0f0-25afdd1a6bda admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.631970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a090-a8dc-48da-a0f0-25afdd1a6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.632241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a090-a8dc-48da-a0f0-25afdd1a6bda admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.633470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a090-a8dc-48da-a0f0-25afdd1a6bda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.635160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a090-a8dc-48da-a0f0-25afdd1a6bda admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.637817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 525/1045] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:01:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:01:58.645547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336326f6-d469-4e6e-9963-7c8f24711a69 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:01:58.654031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336326f6-d469-4e6e-9963-7c8f24711a69 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:01:58.658810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d5f4-61cc-45fb-8620-34d5194df8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:01:58.659478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d5f4-61cc-45fb-8620-34d5194df8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:01:58.659910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d5f4-61cc-45fb-8620-34d5194df8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:01:58.660188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d5f4-61cc-45fb-8620-34d5194df8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:01:58.660911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74d5f4-61cc-45fb-8620-34d5194df8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:01:58.662915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74d5f4-61cc-45fb-8620-34d5194df8e9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:01:58.789111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 521/1046] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:01:58 2022] POST /identity/v3/projects => generated 311 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:02:00.081977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad65ca-400d-4755-8266-575a76afe3dc None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.082514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad65ca-400d-4755-8266-575a76afe3dc None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.082514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad65ca-400d-4755-8266-575a76afe3dc None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.084347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 526/1047] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:00.091142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f860-e244-44b9-9fe7-965859c33e81 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.091625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f860-e244-44b9-9fe7-965859c33e81 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.091739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f860-e244-44b9-9fe7-965859c33e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.109975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4985f860-e244-44b9-9fe7-965859c33e81 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:00.111172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4985f860-e244-44b9-9fe7-965859c33e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:00.175220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 522/1048] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:00.200848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad65ca-400d-4755-8266-575a76afe3dc None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:00.213138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad65ca-400d-4755-8266-575a76afe3dc None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:00.220024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391d3b8-082a-4b6c-85e7-438b41aacc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:00.220680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d3b8-082a-4b6c-85e7-438b41aacc82 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.220968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d3b8-082a-4b6c-85e7-438b41aacc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.221336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391d3b8-082a-4b6c-85e7-438b41aacc82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.230184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391d3b8-082a-4b6c-85e7-438b41aacc82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:00.232660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391d3b8-082a-4b6c-85e7-438b41aacc82 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:00.244722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 527/1049] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:00.251921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f860-e244-44b9-9fe7-965859c33e81 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:00.261009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f860-e244-44b9-9fe7-965859c33e81 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:00.267191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1095c-e24a-45c0-9d95-4c698063500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:00.268042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1095c-e24a-45c0-9d95-4c698063500e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.268330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1095c-e24a-45c0-9d95-4c698063500e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.268626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1095c-e24a-45c0-9d95-4c698063500e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.269877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1095c-e24a-45c0-9d95-4c698063500e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:00.271681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1095c-e24a-45c0-9d95-4c698063500e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:00.273607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 523/1050] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:00.798651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3bea-078e-4a23-9fd7-33f4dc8f98ba None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.798939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3bea-078e-4a23-9fd7-33f4dc8f98ba None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.799217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3bea-078e-4a23-9fd7-33f4dc8f98ba None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.801049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 528/1051] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:00.806914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d7cb-c94b-431b-a79f-d27f2cf5bbba None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.807281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d7cb-c94b-431b-a79f-d27f2cf5bbba None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.807562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d7cb-c94b-431b-a79f-d27f2cf5bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.831453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-65e5d7cb-c94b-431b-a79f-d27f2cf5bbba None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:00.832718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-65e5d7cb-c94b-431b-a79f-d27f2cf5bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:00.842041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 524/1052] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:02:00.866312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca3bea-078e-4a23-9fd7-33f4dc8f98ba None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:00.879069 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca3bea-078e-4a23-9fd7-33f4dc8f98ba None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:00.883565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:00.884373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.884658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.884933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.896808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:00.905864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 18:02:00.907147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 529/1053] 10.222.0.87 () {56 vars in 1141 bytes} [Wed Feb 16 18:02:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:00.913384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d7cb-c94b-431b-a79f-d27f2cf5bbba None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:00.922328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d7cb-c94b-431b-a79f-d27f2cf5bbba None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:00.926793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:00.927447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.927728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.928004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.929392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:00.929702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:00.931278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:00.941592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 525/1054] 10.222.0.87 () {56 vars in 1136 bytes} [Wed Feb 16 18:02:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:00.947630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:00.959286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b1556-6bd0-459c-9524-c5adacf67fac admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:00.964127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:00.965308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:00.965433 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:00.965662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:00.976461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:00.978323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:00.997200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:02:00.999144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 530/1055] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:01.004323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.017038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8da286-c4d2-4a90-b8cf-56e43b3a43d1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.021628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.022297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.022582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.022861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.023596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:01.023902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.025548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.037815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 526/1056] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:01.043935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.054358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6923-641c-45a0-a54e-e8a9d3547525 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.059617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.060409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.060692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.060970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.069096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.071141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.086572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:02:01.087814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 531/1057] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:01.093719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.103578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005c72-cff8-4433-9a86-8a0c7a3568d9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.108377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645c347-a838-4ab4-b474-d5e18b985abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.109057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c347-a838-4ab4-b474-d5e18b985abb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.109435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c347-a838-4ab4-b474-d5e18b985abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.109645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c347-a838-4ab4-b474-d5e18b985abb admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.110476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c347-a838-4ab4-b474-d5e18b985abb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:01.110786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c347-a838-4ab4-b474-d5e18b985abb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.112640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c347-a838-4ab4-b474-d5e18b985abb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.131423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 527/1058] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:01.137701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.147593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9fd41-30f5-4892-8531-bc5b801f76c0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.152214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.153011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.153322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.153596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.164181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.166062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.184652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:02:01.185359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39926-4502-4c02-a182-f8fcbb240db7 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.185652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39926-4502-4c02-a182-f8fcbb240db7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.185851 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 532/1059] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:01.186066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39926-4502-4c02-a182-f8fcbb240db7 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.187933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 528/1060] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:02:01.191441 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.193473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae86a69-00d5-4872-91c4-73628bea8109 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.193768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae86a69-00d5-4872-91c4-73628bea8109 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.194051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae86a69-00d5-4872-91c4-73628bea8109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.202349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45d64c-a780-412f-8db2-d1e1e65003aa admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.207161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.207815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.208097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.208372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.209099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:01.209433 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.211025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.220014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-1ae86a69-00d5-4872-91c4-73628bea8109 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:01.221234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1ae86a69-00d5-4872-91c4-73628bea8109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:01.227549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 533/1061] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:01.228557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.229054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 529/1062] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:02:01.239008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc2d8-3d4e-44dd-8025-60d4079c7ec1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.243538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.244312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.244598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.244875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.253094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.254181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae86a69-00d5-4872-91c4-73628bea8109 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.255050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.263559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae86a69-00d5-4872-91c4-73628bea8109 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.268093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.268870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.269239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.269514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.270206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:02:01.270660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.276107 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 534/1063] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:02:01.276262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.276262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 530/1064] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:01.277996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.279722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.287967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a88eb-eab1-4cfb-b40b-001cd0e9f66a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.289263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54206468-4ca6-4161-906c-79bd3b222231 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.293677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.294685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.294862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c7665-5804-472b-a950-4b4e2b60dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.295060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.295060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.295372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7665-5804-472b-a950-4b4e2b60dc12 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.295372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7665-5804-472b-a950-4b4e2b60dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.295657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7665-5804-472b-a950-4b4e2b60dc12 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.295812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:01.296076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.296766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c7665-5804-472b-a950-4b4e2b60dc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.297968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.298710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c7665-5804-472b-a950-4b4e2b60dc12 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.312054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 535/1065] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:01.319005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:01.329269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35ad3-5661-4c30-8831-403d44c208ad admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:01.333853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029587a4-1b82-45b9-87b7-c9bea6f43529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:01.334733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029587a4-1b82-45b9-87b7-c9bea6f43529 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:01.335015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029587a4-1b82-45b9-87b7-c9bea6f43529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:01.335289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029587a4-1b82-45b9-87b7-c9bea6f43529 admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/28dfb9c84dda4d6799a490a009e867df/roles/f8649a021fd94bc7994f6ccc0fc0c4cd` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:01.337678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029587a4-1b82-45b9-87b7-c9bea6f43529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=28dfb9c84dda4d6799a490a009e867df, role_id=f8649a021fd94bc7994f6ccc0fc0c4cd)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:01.340631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029587a4-1b82-45b9-87b7-c9bea6f43529 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:01.379233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 531/1066] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:02:01 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:02:01.437525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 536/1067] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:02:01 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/28dfb9c84dda4d6799a490a009e867df/roles/f8649a021fd94bc7994f6ccc0fc0c4cd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:02:03.778796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc6b1-9662-416c-8cc6-f45bbb6da563 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.778796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc6b1-9662-416c-8cc6-f45bbb6da563 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.778796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc6b1-9662-416c-8cc6-f45bbb6da563 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.780822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 532/1068] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:03.786536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fc74c-94cf-4573-9e96-996abaaeda0d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.787016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fc74c-94cf-4573-9e96-996abaaeda0d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.787108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fc74c-94cf-4573-9e96-996abaaeda0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.807714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-963fc74c-94cf-4573-9e96-996abaaeda0d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:03.807714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-963fc74c-94cf-4573-9e96-996abaaeda0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:03.855584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad813b7-0ca7-4287-9063-3c0483b74843 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.856027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad813b7-0ca7-4287-9063-3c0483b74843 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.856338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad813b7-0ca7-4287-9063-3c0483b74843 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.858227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 533/1069] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:02:03.863949 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599d86f-1115-439e-9488-4f38c1aa4244 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.864237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599d86f-1115-439e-9488-4f38c1aa4244 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.864514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599d86f-1115-439e-9488-4f38c1aa4244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.870372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 537/1070] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:03.883089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c599d86f-1115-439e-9488-4f38c1aa4244 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:03.884436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c599d86f-1115-439e-9488-4f38c1aa4244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:03.893410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 534/1071] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:02:03.895580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fc74c-94cf-4573-9e96-996abaaeda0d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:03.905594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fc74c-94cf-4573-9e96-996abaaeda0d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:03.910118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:03.910931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.911216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.911493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.918258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599d86f-1115-439e-9488-4f38c1aa4244 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:03.922957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:03.930166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599d86f-1115-439e-9488-4f38c1aa4244 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:03.930724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 18:02:03.932106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 538/1072] 10.222.0.87 () {56 vars in 1141 bytes} [Wed Feb 16 18:02:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:02:03.935417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:03.936220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.936505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.936783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.938563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:03.948713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:03.949586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6aa3f-b5d6-4bcc-a50e-4e171c44af22 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:03.954259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:03.955185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.955550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.955824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.956455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:03.956550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:03.956841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:03.958780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 535/1073] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:02:03.958893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:03.964232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:03.970804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 539/1074] 10.222.0.87 () {56 vars in 1136 bytes} [Wed Feb 16 18:02:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:03.975187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da171-0132-40e6-bdab-42c2263b5c67 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:03.976613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:03.979884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:03.980565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.980852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.981277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.982033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:03.982336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:03.983953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:03.989458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde92a9-fcab-491c-90f9-9c8eb09a932b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:03.992813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 536/1075] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:03.994111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:03.994904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:03.995191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:03.995469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:03.999300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.007119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.008832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041ebba-f26c-409f-9370-194bd22ea54f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.008957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.013987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.014854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.015130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.015399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] PATH_INFO: `/v3/users/d0ef28fb150240d5a2ca8c0841acebb2` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.027546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:02:04.033605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 540/1076] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:02:04.033818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] RBAC: Authorizing `identity:get_user(user_id=d0ef28fb150240d5a2ca8c0841acebb2)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.033818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.033818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 537/1077] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:03 2022] GET /identity/v3/users/d0ef28fb150240d5a2ca8c0841acebb2 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:04.035102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.038846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.045682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d576e-e04c-441e-a124-0fed1114555b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.049641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09519ae5-4879-46db-b777-5dbcf77b47fb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.050566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.051221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.051512 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.051784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.052501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:04.052805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.054833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.055799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.056442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.056728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.057037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.065861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.067662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.068994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 541/1078] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:04.075576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.078492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 538/1079] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:02:04.084295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.085424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be4f1e-6a1c-4074-b634-b55bdac2db90 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.090320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.091072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.091360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.091637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.093025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a759a89-b43f-49dd-87fc-f5e82f570acc admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.097616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.098470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.098755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.099032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.099849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.100204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] RBAC: Authorizing `identity:get_project(project_id=2cb362a484f1401ebfa24a5fe3e40f33)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.101882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.102293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.104001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 539/1080] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:04.110980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.116425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 18:02:04.117677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 542/1081] 10.222.0.87 () {56 vars in 1114 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:02:04.121428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e3503-1662-4171-826a-0b8fce0a6d89 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.124130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.128103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.128103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.128103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.128103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.129228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33, user.id=d0ef28fb150240d5a2ca8c0841acebb2) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:04.129228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.130662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.134466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467facd-897b-4bac-8a8b-42d2913a256d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.149138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 540/1082] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/role_assignments?user.id=d0ef28fb150240d5a2ca8c0841acebb2&scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:04.149372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.149372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.149372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.149372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.149674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:04.149674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.149674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.164642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 543/1083] 10.222.0.87 () {56 vars in 1154 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:04.170729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.181198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acca97-3ba3-4fd0-9d13-d030395fc659 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.186623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.187275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.187561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.187837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.196760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.198570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.209162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 541/1084] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:04.215290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.225476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c30a4-2ac5-438c-b3e6-48136d805d52 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.230337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.231232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.231514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.231788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.243369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.245253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.266392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:02:04.267683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 544/1085] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:04.273676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.283244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f6d0d-056b-49f4-918c-0ffbf41a781b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.287926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.288533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.288812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.289108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.289822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:04.290125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.291770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.305381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 542/1086] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:04.312288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.322134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83be5e-9dc4-4150-89bd-1168a116459c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.326876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.327780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.327956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.328216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.335804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.337903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.352277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:02:04.353550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 545/1087] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:04.360457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.371330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c29570-4ccf-47d4-8930-41815d3cf948 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.376628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef27113-7cb0-4647-b179-2705ed9b8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.377343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef27113-7cb0-4647-b179-2705ed9b8fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.377632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef27113-7cb0-4647-b179-2705ed9b8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.377892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef27113-7cb0-4647-b179-2705ed9b8fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.378678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef27113-7cb0-4647-b179-2705ed9b8fa3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:04.378987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef27113-7cb0-4647-b179-2705ed9b8fa3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.380927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef27113-7cb0-4647-b179-2705ed9b8fa3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.479508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 543/1088] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:04.486602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:04.498297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c249ba-a2c9-4104-a155-f8626b6346fc admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:04.503176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0751626-1897-439b-9464-55a95ca1c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:04.503824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751626-1897-439b-9464-55a95ca1c2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:04.504106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751626-1897-439b-9464-55a95ca1c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:04.504380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0751626-1897-439b-9464-55a95ca1c2ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:04.505242 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0751626-1897-439b-9464-55a95ca1c2ba admin admin] RBAC: Adding query filter params (role.id=f8649a021fd94bc7994f6ccc0fc0c4cd, scope.project.id=578059b701674f41b39442d2a018b489, user.id=28dfb9c84dda4d6799a490a009e867df) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:04.505553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0751626-1897-439b-9464-55a95ca1c2ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:04.507399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0751626-1897-439b-9464-55a95ca1c2ba admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:04.514335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 546/1089] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:04 2022] GET /identity/v3/role_assignments?user.id=28dfb9c84dda4d6799a490a009e867df&scope.project.id=578059b701674f41b39442d2a018b489&role.id=f8649a021fd94bc7994f6ccc0fc0c4cd => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:06.554314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ac81-55a7-41dc-b617-3ea4898ee31e None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:06.554816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ac81-55a7-41dc-b617-3ea4898ee31e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:06.554816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234ac81-55a7-41dc-b617-3ea4898ee31e None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:06.556585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 544/1090] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:06.563076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fc705-96b4-4356-a2ac-2c449c8f9137 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:06.563518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fc705-96b4-4356-a2ac-2c449c8f9137 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:06.563635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fc705-96b4-4356-a2ac-2c449c8f9137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:06.581404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7d6fc705-96b4-4356-a2ac-2c449c8f9137 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:06.582622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7d6fc705-96b4-4356-a2ac-2c449c8f9137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:06.590268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 547/1091] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:02:06.614017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ac81-55a7-41dc-b617-3ea4898ee31e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:06.627505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234ac81-55a7-41dc-b617-3ea4898ee31e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:06.631953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:06.632744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:06.633032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:06.633342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:06.643931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:06.650974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:06.652219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 545/1092] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:06.658570 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fc705-96b4-4356-a2ac-2c449c8f9137 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:06.668132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fc705-96b4-4356-a2ac-2c449c8f9137 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:06.672925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:06.673621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:06.673907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:06.674180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:06.674915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:06.675218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:06.676805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:06.686465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 548/1093] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:06.692299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:06.703415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf744-0950-460f-8f75-912331273dd4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:06.707940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:06.708795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:06.709100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:06.709396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] PATH_INFO: `/v3/users/d0ef28fb150240d5a2ca8c0841acebb2` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:06.710582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] RBAC: Authorizing `identity:get_user(user_id=d0ef28fb150240d5a2ca8c0841acebb2)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:06.712717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:06.714470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 546/1094] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:06 2022] GET /identity/v3/users/d0ef28fb150240d5a2ca8c0841acebb2 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:06.720462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:06.730928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d6ef-bd0d-4589-9c44-b51a4171ba2d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:06.735679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8a120-6914-4ee1-93db-ad3336925580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:06.736536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a120-6914-4ee1-93db-ad3336925580 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:06.736819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a120-6914-4ee1-93db-ad3336925580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:06.737122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8a120-6914-4ee1-93db-ad3336925580 admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:06.738301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a120-6914-4ee1-93db-ad3336925580 admin admin] RBAC: Authorizing `identity:get_project(project_id=2cb362a484f1401ebfa24a5fe3e40f33)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:06.740400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8a120-6914-4ee1-93db-ad3336925580 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:06.742126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 549/1095] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:06 2022] GET /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:06.749527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:06.759379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d9a10-8b79-47c9-842c-57ee4c98847d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:06.764581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4811a-4835-4456-908b-10ad208bdabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:06.765502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4811a-4835-4456-908b-10ad208bdabc admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:06.765785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4811a-4835-4456-908b-10ad208bdabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:06.766063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4811a-4835-4456-908b-10ad208bdabc admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33/users/d0ef28fb150240d5a2ca8c0841acebb2/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:06.768028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4811a-4835-4456-908b-10ad208bdabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb362a484f1401ebfa24a5fe3e40f33, user_id=d0ef28fb150240d5a2ca8c0841acebb2, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:06.770707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4811a-4835-4456-908b-10ad208bdabc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:06.876148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 547/1096] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:02:06 2022] PUT /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33/users/d0ef28fb150240d5a2ca8c0841acebb2/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:02:09.191455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90531f-e278-4855-9853-f7ef0e3a017a None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.191993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90531f-e278-4855-9853-f7ef0e3a017a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.191993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90531f-e278-4855-9853-f7ef0e3a017a None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.193849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 550/1097] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:09.200125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055961e-a10f-4557-b871-9964c9a9e5e7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.200644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055961e-a10f-4557-b871-9964c9a9e5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.200644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055961e-a10f-4557-b871-9964c9a9e5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.218751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c055961e-a10f-4557-b871-9964c9a9e5e7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:09.219955 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c055961e-a10f-4557-b871-9964c9a9e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:09.292948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 548/1098] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:09.318380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90531f-e278-4855-9853-f7ef0e3a017a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:09.331855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90531f-e278-4855-9853-f7ef0e3a017a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:09.336332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:09.337162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.337565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.337841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.349742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:09.356740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:09.357982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 551/1099] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:09.364162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055961e-a10f-4557-b871-9964c9a9e5e7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:09.374383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055961e-a10f-4557-b871-9964c9a9e5e7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:09.379015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:09.379689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.379973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.380248 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.380994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:09.381327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:09.382917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:09.392761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 549/1100] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:09.399014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:09.409470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29370438-2a4c-4567-9bae-51263fe5d3ba admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:09.414300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:09.415196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.415482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.415802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] PATH_INFO: `/v3/users/d0ef28fb150240d5a2ca8c0841acebb2` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.417033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] RBAC: Authorizing `identity:get_user(user_id=d0ef28fb150240d5a2ca8c0841acebb2)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:09.419600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:09.421333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 552/1101] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:09 2022] GET /identity/v3/users/d0ef28fb150240d5a2ca8c0841acebb2 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:09.427163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:09.439765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b594d2c-cc4e-4cfd-8cf5-7bbf4a8a789e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:09.444448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:09.445035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.445353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.445635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.455259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:09.456999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:09.466299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 550/1102] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:09.472290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:09.482535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ad0b1-7b28-4b60-83aa-fbba18fae188 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:09.487086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841453-9cc9-4cb6-a9ca-a5264077b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:09.487958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841453-9cc9-4cb6-a9ca-a5264077b6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.488240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841453-9cc9-4cb6-a9ca-a5264077b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.488512 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841453-9cc9-4cb6-a9ca-a5264077b6b4 admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.489697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841453-9cc9-4cb6-a9ca-a5264077b6b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2cb362a484f1401ebfa24a5fe3e40f33)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:09.491809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841453-9cc9-4cb6-a9ca-a5264077b6b4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:09.493547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 553/1103] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:09 2022] GET /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:09.500756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:09.509746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946f8ae-809d-4314-8df4-45a9f6387623 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:09.516045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26064973-8a84-4db3-b977-0aecabaa6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:09.516696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26064973-8a84-4db3-b977-0aecabaa6390 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:09.516983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26064973-8a84-4db3-b977-0aecabaa6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:09.517291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26064973-8a84-4db3-b977-0aecabaa6390 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:09.518114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26064973-8a84-4db3-b977-0aecabaa6390 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33, user.id=d0ef28fb150240d5a2ca8c0841acebb2) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:09.518429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26064973-8a84-4db3-b977-0aecabaa6390 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:09.520267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26064973-8a84-4db3-b977-0aecabaa6390 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:09.526493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 551/1104] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:09 2022] GET /identity/v3/role_assignments?user.id=d0ef28fb150240d5a2ca8c0841acebb2&scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:11.929002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1465-0c7d-417e-a213-d09e5a959f97 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:11.929604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1465-0c7d-417e-a213-d09e5a959f97 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:11.929604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1465-0c7d-417e-a213-d09e5a959f97 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:11.931328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 554/1105] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:11.937294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b570bdb-f74d-4bb0-8335-b174f57f103b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:11.937729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b570bdb-f74d-4bb0-8335-b174f57f103b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:11.937854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b570bdb-f74d-4bb0-8335-b174f57f103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:11.955485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4b570bdb-f74d-4bb0-8335-b174f57f103b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:11.956673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4b570bdb-f74d-4bb0-8335-b174f57f103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:11.964470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 552/1106] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:11.990264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1465-0c7d-417e-a213-d09e5a959f97 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:12.002996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1465-0c7d-417e-a213-d09e5a959f97 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:12.007390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598f894-660a-4261-af29-b5f70b593415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:12.008164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f894-660a-4261-af29-b5f70b593415 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:12.008448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f894-660a-4261-af29-b5f70b593415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:12.008724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598f894-660a-4261-af29-b5f70b593415 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:12.009917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f894-660a-4261-af29-b5f70b593415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:12.011587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598f894-660a-4261-af29-b5f70b593415 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:12.013359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 555/1107] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:12.018694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b570bdb-f74d-4bb0-8335-b174f57f103b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:12.027913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b570bdb-f74d-4bb0-8335-b174f57f103b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:12.032592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec4e97-8553-440f-a42c-f6278ed0cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:12.033306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4e97-8553-440f-a42c-f6278ed0cae4 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:12.033602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4e97-8553-440f-a42c-f6278ed0cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:12.033884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4e97-8553-440f-a42c-f6278ed0cae4 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:12.034581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec4e97-8553-440f-a42c-f6278ed0cae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:12.036548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec4e97-8553-440f-a42c-f6278ed0cae4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:12.189311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 553/1108] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:02:12 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:02:14.628923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a55b0-9a18-4af7-a7a1-0a177504e0f3 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:14.629494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a55b0-9a18-4af7-a7a1-0a177504e0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:14.629494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a55b0-9a18-4af7-a7a1-0a177504e0f3 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:14.631188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 556/1109] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:14.637256 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bdd2-75c4-4cd6-a9f2-b96d386052a5 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:14.637960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bdd2-75c4-4cd6-a9f2-b96d386052a5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:14.637960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0bdd2-75c4-4cd6-a9f2-b96d386052a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:14.664993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b9b0bdd2-75c4-4cd6-a9f2-b96d386052a5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:14.666996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b9b0bdd2-75c4-4cd6-a9f2-b96d386052a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:14.680172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 554/1110] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:14.706353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a55b0-9a18-4af7-a7a1-0a177504e0f3 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:14.726139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a55b0-9a18-4af7-a7a1-0a177504e0f3 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:14.733572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:14.734995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:14.735495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:14.735991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] PATH_INFO: `/v3/roles/dc6090b70eff456892de81377068fadd` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:14.738531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] RBAC: Authorizing `identity:get_role(role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:14.740344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:02:14.740344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:02:14.740344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:02:14.741928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:14.744280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 557/1111] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:14 2022] GET /identity/v3/roles/dc6090b70eff456892de81377068fadd => generated 223 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:14.751138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0bdd2-75c4-4cd6-a9f2-b96d386052a5 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:14.760217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0bdd2-75c4-4cd6-a9f2-b96d386052a5 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:14.766272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:14.767149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:14.767438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:14.767708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] PATH_INFO: `/v3/users/ace90f682d394781a2cae91444795fe7` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:14.785602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] RBAC: Authorizing `identity:get_user(user_id=ace90f682d394781a2cae91444795fe7)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:14.787441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:14.789167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 555/1112] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:14 2022] GET /identity/v3/users/ace90f682d394781a2cae91444795fe7 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:14.796421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:14.806678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db4ae6-b429-4c1f-9043-97d282931410 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:14.812657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:14.813332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:14.813617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:14.813890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:14.822858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:14.824706 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:14.833530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 558/1113] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:14.840165 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:14.850780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45dec4-1db0-4db3-a309-4d96763a3bc5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:14.856159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8aa5c-fd84-4187-83ba-1a92a63dd5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:14.857002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8aa5c-fd84-4187-83ba-1a92a63dd5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:14.857307 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8aa5c-fd84-4187-83ba-1a92a63dd5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:14.857581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8aa5c-fd84-4187-83ba-1a92a63dd5f7 admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:14.858885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8aa5c-fd84-4187-83ba-1a92a63dd5f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=2cb362a484f1401ebfa24a5fe3e40f33)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:14.860885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8aa5c-fd84-4187-83ba-1a92a63dd5f7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:14.862573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 556/1114] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:14 2022] GET /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:14.868738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:14.878738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753866e-853c-4e46-a413-e6c202580f5a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:14.883439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c6d38-9a19-40bf-a063-eb41af0f9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:14.884062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6d38-9a19-40bf-a063-eb41af0f9908 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:14.884347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6d38-9a19-40bf-a063-eb41af0f9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:14.884625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6d38-9a19-40bf-a063-eb41af0f9908 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:14.885489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6d38-9a19-40bf-a063-eb41af0f9908 admin admin] RBAC: Adding query filter params (role.id=dc6090b70eff456892de81377068fadd, scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33, user.id=ace90f682d394781a2cae91444795fe7) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:14.885807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6d38-9a19-40bf-a063-eb41af0f9908 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:14.887970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6d38-9a19-40bf-a063-eb41af0f9908 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:14.893388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 559/1115] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:14 2022] GET /identity/v3/role_assignments?user.id=ace90f682d394781a2cae91444795fe7&scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33&role.id=dc6090b70eff456892de81377068fadd => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:17.254928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99565cf-53ff-4557-b060-77488b153be3 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:17.255481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99565cf-53ff-4557-b060-77488b153be3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:17.255481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99565cf-53ff-4557-b060-77488b153be3 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:17.257299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 557/1116] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:17.263000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af75d-ae74-43e9-a6ff-d47ddc4c407b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:17.263436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af75d-ae74-43e9-a6ff-d47ddc4c407b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:17.263564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af75d-ae74-43e9-a6ff-d47ddc4c407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:17.281216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-fb7af75d-ae74-43e9-a6ff-d47ddc4c407b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:17.282403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fb7af75d-ae74-43e9-a6ff-d47ddc4c407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:17.289985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 560/1117] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:17.314360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99565cf-53ff-4557-b060-77488b153be3 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:17.326290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99565cf-53ff-4557-b060-77488b153be3 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:17.330721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:17.331555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:17.331832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:17.332101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] PATH_INFO: `/v3/roles/dc6090b70eff456892de81377068fadd` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:17.333574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] RBAC: Authorizing `identity:get_role(role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:17.334585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:02:17.334585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:02:17.334585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:02:17.335481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:17.336823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 558/1118] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:17 2022] GET /identity/v3/roles/dc6090b70eff456892de81377068fadd => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:17.343327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af75d-ae74-43e9-a6ff-d47ddc4c407b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:17.352146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af75d-ae74-43e9-a6ff-d47ddc4c407b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:17.357115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:17.357969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:17.358246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:17.358517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] PATH_INFO: `/v3/users/ace90f682d394781a2cae91444795fe7` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:17.359696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] RBAC: Authorizing `identity:get_user(user_id=ace90f682d394781a2cae91444795fe7)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:17.361829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:17.363507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 561/1119] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:17 2022] GET /identity/v3/users/ace90f682d394781a2cae91444795fe7 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:17.369552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:17.380490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90e38-6a32-4e18-848f-e483eeac0e7c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:17.385378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7576339-e6c9-47aa-b174-93d5b96a39b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:17.386239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7576339-e6c9-47aa-b174-93d5b96a39b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:17.387173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7576339-e6c9-47aa-b174-93d5b96a39b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:17.387459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7576339-e6c9-47aa-b174-93d5b96a39b0 admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:17.388673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7576339-e6c9-47aa-b174-93d5b96a39b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=2cb362a484f1401ebfa24a5fe3e40f33)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:17.390799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7576339-e6c9-47aa-b174-93d5b96a39b0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:17.392499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 559/1120] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:17 2022] GET /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:17.398730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:17.409551 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4cd4a-1e54-417e-b35d-3c04040f4093 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:17.414095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb5abd-cdee-4d69-97d3-794b35719788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:17.414995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb5abd-cdee-4d69-97d3-794b35719788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:17.415280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb5abd-cdee-4d69-97d3-794b35719788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:17.415560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb5abd-cdee-4d69-97d3-794b35719788 admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33/users/ace90f682d394781a2cae91444795fe7/roles/dc6090b70eff456892de81377068fadd` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:17.419956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb5abd-cdee-4d69-97d3-794b35719788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb362a484f1401ebfa24a5fe3e40f33, user_id=ace90f682d394781a2cae91444795fe7, role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:17.422677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb5abd-cdee-4d69-97d3-794b35719788 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:17.505297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 562/1121] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:02:17 2022] PUT /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33/users/ace90f682d394781a2cae91444795fe7/roles/dc6090b70eff456892de81377068fadd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:02:19.867155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b470613-0aa5-472e-903d-0d4a4cd765fd None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:19.867725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b470613-0aa5-472e-903d-0d4a4cd765fd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:19.868122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b470613-0aa5-472e-903d-0d4a4cd765fd None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:19.871410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 560/1122] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:19.879071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a714-1a08-433e-b012-633bf348312b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:19.879552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a714-1a08-433e-b012-633bf348312b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:19.879644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a714-1a08-433e-b012-633bf348312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:19.898169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6132a714-1a08-433e-b012-633bf348312b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:19.899375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6132a714-1a08-433e-b012-633bf348312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:19.958624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 563/1123] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:19.983092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b470613-0aa5-472e-903d-0d4a4cd765fd None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:19.998704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b470613-0aa5-472e-903d-0d4a4cd765fd None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:20.004013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:20.005023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:20.005338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:20.005616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] PATH_INFO: `/v3/roles/dc6090b70eff456892de81377068fadd` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:20.007117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] RBAC: Authorizing `identity:get_role(role_id=dc6090b70eff456892de81377068fadd)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:20.008709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:20.010130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 561/1124] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:19 2022] GET /identity/v3/roles/dc6090b70eff456892de81377068fadd => generated 223 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:20.017488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a714-1a08-433e-b012-633bf348312b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:20.028407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a714-1a08-433e-b012-633bf348312b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:20.033016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:20.033916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:20.034240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:20.034515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] PATH_INFO: `/v3/users/ace90f682d394781a2cae91444795fe7` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:20.035736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=ace90f682d394781a2cae91444795fe7)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:20.037892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:20.039587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 564/1125] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:20 2022] GET /identity/v3/users/ace90f682d394781a2cae91444795fe7 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:20.045548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:20.055749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88152c99-043b-4ede-aa0d-84dc4ad72fb1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:20.061044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:20.061733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:20.062012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:20.062284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:20.070617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:20.072353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:20.082120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 562/1126] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:20.088254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:20.097991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4149d9-bfb0-4e41-92c9-77fe02ee52e6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:20.102711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e1348-8c86-46bd-9a3f-7b5e2bd325b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:20.103573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e1348-8c86-46bd-9a3f-7b5e2bd325b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:20.103856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e1348-8c86-46bd-9a3f-7b5e2bd325b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:20.104127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e1348-8c86-46bd-9a3f-7b5e2bd325b3 admin admin] PATH_INFO: `/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:20.105481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e1348-8c86-46bd-9a3f-7b5e2bd325b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2cb362a484f1401ebfa24a5fe3e40f33)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:20.107536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e1348-8c86-46bd-9a3f-7b5e2bd325b3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:20.109289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 565/1127] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:20 2022] GET /identity/v3/projects/2cb362a484f1401ebfa24a5fe3e40f33 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:20.115561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:20.125374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0b362-8285-4249-bb1f-1c9a53f731b9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:20.130011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf991d1-a8d4-4a99-b7c7-e08ee33f0304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:20.130718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf991d1-a8d4-4a99-b7c7-e08ee33f0304 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:20.131006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf991d1-a8d4-4a99-b7c7-e08ee33f0304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:20.131312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf991d1-a8d4-4a99-b7c7-e08ee33f0304 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:20.132177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf991d1-a8d4-4a99-b7c7-e08ee33f0304 admin admin] RBAC: Adding query filter params (role.id=dc6090b70eff456892de81377068fadd, scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33, user.id=ace90f682d394781a2cae91444795fe7) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:20.132493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf991d1-a8d4-4a99-b7c7-e08ee33f0304 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:20.134369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf991d1-a8d4-4a99-b7c7-e08ee33f0304 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:20.141778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 563/1128] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:20 2022] GET /identity/v3/role_assignments?user.id=ace90f682d394781a2cae91444795fe7&scope.project.id=2cb362a484f1401ebfa24a5fe3e40f33&role.id=dc6090b70eff456892de81377068fadd => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:22.512289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42f5d-08c1-4968-a363-8b0a61f1fc91 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:22.512811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42f5d-08c1-4968-a363-8b0a61f1fc91 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:22.512811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42f5d-08c1-4968-a363-8b0a61f1fc91 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:22.514567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 566/1129] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:22.520059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f393b-1901-43ae-94b6-4176c5970e5b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:22.520548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f393b-1901-43ae-94b6-4176c5970e5b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:22.520649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f393b-1901-43ae-94b6-4176c5970e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:22.538614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-de0f393b-1901-43ae-94b6-4176c5970e5b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:22.539814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-de0f393b-1901-43ae-94b6-4176c5970e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:22.548040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 564/1130] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:22.572971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb42f5d-08c1-4968-a363-8b0a61f1fc91 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:22.586121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb42f5d-08c1-4968-a363-8b0a61f1fc91 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:22.593014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850234-5ebf-4fa3-a59a-6fc3e9bfe8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:22.594004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850234-5ebf-4fa3-a59a-6fc3e9bfe8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:22.594288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850234-5ebf-4fa3-a59a-6fc3e9bfe8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:22.594565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850234-5ebf-4fa3-a59a-6fc3e9bfe8ea admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:22.595780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850234-5ebf-4fa3-a59a-6fc3e9bfe8ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:22.597500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850234-5ebf-4fa3-a59a-6fc3e9bfe8ea admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:22.599104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 567/1131] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:22.605873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f393b-1901-43ae-94b6-4176c5970e5b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:22.615238 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f393b-1901-43ae-94b6-4176c5970e5b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:22.620303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec525eb0-aefa-40e4-a675-d7d41cb9f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:22.621193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525eb0-aefa-40e4-a675-d7d41cb9f409 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:22.621683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525eb0-aefa-40e4-a675-d7d41cb9f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:22.621973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525eb0-aefa-40e4-a675-d7d41cb9f409 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:22.622807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec525eb0-aefa-40e4-a675-d7d41cb9f409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:22.624722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec525eb0-aefa-40e4-a675-d7d41cb9f409 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:22.709383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 565/1132] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:02:22 2022] POST /identity/v3/projects => generated 311 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:02:25.080753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5665283-91ca-414c-ac85-8a9757d8462c None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:25.081387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5665283-91ca-414c-ac85-8a9757d8462c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:25.081387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5665283-91ca-414c-ac85-8a9757d8462c None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:25.083140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 568/1133] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:25.088567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8956f3-2408-446a-a7cd-c12984420832 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:25.089004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8956f3-2408-446a-a7cd-c12984420832 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:25.089131 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8956f3-2408-446a-a7cd-c12984420832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:25.107339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-df8956f3-2408-446a-a7cd-c12984420832 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:25.108538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-df8956f3-2408-446a-a7cd-c12984420832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:25.165948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 566/1134] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:25.192063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5665283-91ca-414c-ac85-8a9757d8462c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:25.205981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5665283-91ca-414c-ac85-8a9757d8462c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:25.210388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f06515-a7e7-4747-8ea5-09c16ce9ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:25.211179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06515-a7e7-4747-8ea5-09c16ce9ec93 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:25.211467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06515-a7e7-4747-8ea5-09c16ce9ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:25.211746 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06515-a7e7-4747-8ea5-09c16ce9ec93 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:25.212916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f06515-a7e7-4747-8ea5-09c16ce9ec93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:25.215420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f06515-a7e7-4747-8ea5-09c16ce9ec93 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:25.217075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 569/1135] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:02:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:25.223886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8956f3-2408-446a-a7cd-c12984420832 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:25.233454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8956f3-2408-446a-a7cd-c12984420832 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:25.238179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4316169-cae7-4b9c-8f66-5f9a119704f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:25.238856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316169-cae7-4b9c-8f66-5f9a119704f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:25.239143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316169-cae7-4b9c-8f66-5f9a119704f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:25.239421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4316169-cae7-4b9c-8f66-5f9a119704f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:25.240145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4316169-cae7-4b9c-8f66-5f9a119704f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:25.242107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4316169-cae7-4b9c-8f66-5f9a119704f0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:25.332752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 567/1136] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:02:25 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:02:27.736960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3c9f-008d-4ec3-8024-5ba0835793ca None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:27.737557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3c9f-008d-4ec3-8024-5ba0835793ca None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:27.737557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb3c9f-008d-4ec3-8024-5ba0835793ca None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:27.739317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 570/1137] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:27.744733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0447222-a3ac-4103-84cd-50d5e4d676ef None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:27.745230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0447222-a3ac-4103-84cd-50d5e4d676ef None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:27.745323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0447222-a3ac-4103-84cd-50d5e4d676ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:27.763113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b0447222-a3ac-4103-84cd-50d5e4d676ef None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:27.764316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b0447222-a3ac-4103-84cd-50d5e4d676ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:27.772118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 568/1138] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:27.797509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb3c9f-008d-4ec3-8024-5ba0835793ca None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:27.810614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb3c9f-008d-4ec3-8024-5ba0835793ca None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:27.815045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:27.815826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:27.816108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:27.816383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:27.827449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:27.834394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:27.835595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 571/1139] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:27.842136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0447222-a3ac-4103-84cd-50d5e4d676ef None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:27.851059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0447222-a3ac-4103-84cd-50d5e4d676ef None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:27.855997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:27.856654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:27.856937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:27.857246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:27.857984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:27.858287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:27.859854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:27.868235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 569/1140] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:27.874769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:27.885053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1ce2e-357e-4123-9779-d2b130289be2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:27.890569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:27.891436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:27.891721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:27.892000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] PATH_INFO: `/v3/users/b2fc78a9276a4d32be82e54e7a8c49ff` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:27.906257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2fc78a9276a4d32be82e54e7a8c49ff)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:27.908417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:27.910154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 572/1141] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:27 2022] GET /identity/v3/users/b2fc78a9276a4d32be82e54e7a8c49ff => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:27.916044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:27.926645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3591c-99f8-449c-82e5-d5db49992f49 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:27.931465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:27.932105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:27.932389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:27.932663 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:27.940654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:27.942424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:27.951772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 570/1142] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:27.957997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:27.968433 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f332-8383-4f5e-8869-a04debe58bd6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:27.973139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59f41-39ef-43c2-af9b-b49c38e9715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:27.973999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59f41-39ef-43c2-af9b-b49c38e9715e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:27.974283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59f41-39ef-43c2-af9b-b49c38e9715e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:27.974561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59f41-39ef-43c2-af9b-b49c38e9715e admin admin] PATH_INFO: `/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:27.975729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc59f41-39ef-43c2-af9b-b49c38e9715e admin admin] RBAC: Authorizing `identity:get_project(project_id=8300baf6ed2c4eba886c7740cbf7fab9)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:27.977817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc59f41-39ef-43c2-af9b-b49c38e9715e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:27.979491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 573/1143] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:27 2022] GET /identity/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:27.986582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:27.996191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615de8b-48a5-4c67-b428-e138db0217a9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:28.000775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf26248-a7a3-4a23-8f10-32a02bd3d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:28.001464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf26248-a7a3-4a23-8f10-32a02bd3d6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:28.001744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf26248-a7a3-4a23-8f10-32a02bd3d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:28.002020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf26248-a7a3-4a23-8f10-32a02bd3d6a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:28.002840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf26248-a7a3-4a23-8f10-32a02bd3d6a7 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=8300baf6ed2c4eba886c7740cbf7fab9, user.id=b2fc78a9276a4d32be82e54e7a8c49ff) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:28.003152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf26248-a7a3-4a23-8f10-32a02bd3d6a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:28.004984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf26248-a7a3-4a23-8f10-32a02bd3d6a7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:28.010813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 571/1144] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:27 2022] GET /identity/v3/role_assignments?user.id=b2fc78a9276a4d32be82e54e7a8c49ff&scope.project.id=8300baf6ed2c4eba886c7740cbf7fab9&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:30.302875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590ea8-930d-442c-a723-245477f9f7b6 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:30.303439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590ea8-930d-442c-a723-245477f9f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:30.303439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71590ea8-930d-442c-a723-245477f9f7b6 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:30.305607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 574/1145] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:30.311495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c280c00-1921-47fa-862d-f222496ff212 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:30.311928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c280c00-1921-47fa-862d-f222496ff212 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:30.312028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c280c00-1921-47fa-862d-f222496ff212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:30.331256 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2c280c00-1921-47fa-862d-f222496ff212 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:30.332454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2c280c00-1921-47fa-862d-f222496ff212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:30.340218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 572/1146] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:02:30.363971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71590ea8-930d-442c-a723-245477f9f7b6 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:30.376921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71590ea8-930d-442c-a723-245477f9f7b6 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:30.381486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:30.382266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:30.382548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:30.382824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:30.392919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:30.399830 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:30.401165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 575/1147] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:02:30.407290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c280c00-1921-47fa-862d-f222496ff212 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:30.416172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c280c00-1921-47fa-862d-f222496ff212 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:30.421357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:30.422016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:30.422298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:30.422573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:30.423312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:30.423617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:30.425258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:30.434237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 573/1148] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:30.439876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:30.450244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e1de5-d19b-41e3-913d-58c5896dd2fb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:30.454694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:30.455518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:30.455807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:30.456083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] PATH_INFO: `/v3/users/b2fc78a9276a4d32be82e54e7a8c49ff` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:30.457299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] RBAC: Authorizing `identity:get_user(user_id=b2fc78a9276a4d32be82e54e7a8c49ff)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:30.459392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:30.460943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 576/1149] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:30 2022] GET /identity/v3/users/b2fc78a9276a4d32be82e54e7a8c49ff => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:30.466545 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:30.475966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a06b-a837-4704-af89-5e74cbfe790b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:30.481149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a6179-0b2b-45a6-9444-46402c2703c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:30.481994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a6179-0b2b-45a6-9444-46402c2703c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:30.482276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a6179-0b2b-45a6-9444-46402c2703c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:30.482551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a6179-0b2b-45a6-9444-46402c2703c4 admin admin] PATH_INFO: `/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:30.483754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a6179-0b2b-45a6-9444-46402c2703c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=8300baf6ed2c4eba886c7740cbf7fab9)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:30.485794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a6179-0b2b-45a6-9444-46402c2703c4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:30.487434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 574/1150] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:30 2022] GET /identity/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:30.492984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:30.503414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf38d-fa78-4333-9b3a-2b261fcde1bb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:30.507878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9a9f4-9df6-4451-83bd-ba7144407697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:30.508742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a9f4-9df6-4451-83bd-ba7144407697 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:30.509024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a9f4-9df6-4451-83bd-ba7144407697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:30.509322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a9f4-9df6-4451-83bd-ba7144407697 admin admin] PATH_INFO: `/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9/users/b2fc78a9276a4d32be82e54e7a8c49ff/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:30.511226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9a9f4-9df6-4451-83bd-ba7144407697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8300baf6ed2c4eba886c7740cbf7fab9, user_id=b2fc78a9276a4d32be82e54e7a8c49ff, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:30.514099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9a9f4-9df6-4451-83bd-ba7144407697 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:30.612653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 577/1151] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:02:30 2022] PUT /identity/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9/users/b2fc78a9276a4d32be82e54e7a8c49ff/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:02:32.909535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4975-e7d3-47a2-8cfe-a4d5a8568559 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:32.910098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4975-e7d3-47a2-8cfe-a4d5a8568559 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:32.910098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d4975-e7d3-47a2-8cfe-a4d5a8568559 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:32.911937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 575/1152] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:32.918102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4237-21b1-4248-a03a-d13e51a83beb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:32.919191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4237-21b1-4248-a03a-d13e51a83beb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:32.919191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4237-21b1-4248-a03a-d13e51a83beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:32.936598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-22df4237-21b1-4248-a03a-d13e51a83beb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:32.937848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-22df4237-21b1-4248-a03a-d13e51a83beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:33.005760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 578/1153] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:33.031076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4975-e7d3-47a2-8cfe-a4d5a8568559 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:33.045118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d4975-e7d3-47a2-8cfe-a4d5a8568559 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:33.049548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:33.050341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:33.050625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:33.050900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:33.062186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:33.069284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:33.070578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 576/1154] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:33.079344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df4237-21b1-4248-a03a-d13e51a83beb None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:33.088798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df4237-21b1-4248-a03a-d13e51a83beb None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:33.094785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:33.095455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:33.095741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:33.096018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:33.096767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:33.097074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:33.098861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:33.108984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 579/1155] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:33.114876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:33.126634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9e958-c11e-4bd8-86a7-24309e8666de admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:33.131429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:33.132299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:33.132584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:33.132862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] PATH_INFO: `/v3/users/b2fc78a9276a4d32be82e54e7a8c49ff` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:33.134123 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2fc78a9276a4d32be82e54e7a8c49ff)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:33.136492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:33.138795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 577/1156] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:33 2022] GET /identity/v3/users/b2fc78a9276a4d32be82e54e7a8c49ff => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:33.144737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:33.155123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145bfc3-cf6a-4759-b956-7ce468ff7a94 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:33.159976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:33.160539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:33.160825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:33.161122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:33.170134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:33.171911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:33.181276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 580/1157] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:33.187781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:33.199393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79a134-a0e8-454d-8a66-836612cb08d0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:33.204536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd6007-35e0-41d0-8695-f860edbdc859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:33.205436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6007-35e0-41d0-8695-f860edbdc859 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:33.205723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6007-35e0-41d0-8695-f860edbdc859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:33.206000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd6007-35e0-41d0-8695-f860edbdc859 admin admin] PATH_INFO: `/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:33.207229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd6007-35e0-41d0-8695-f860edbdc859 admin admin] RBAC: Authorizing `identity:get_project(project_id=8300baf6ed2c4eba886c7740cbf7fab9)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:33.209608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd6007-35e0-41d0-8695-f860edbdc859 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:33.211321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 578/1158] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:33 2022] GET /identity/v3/projects/8300baf6ed2c4eba886c7740cbf7fab9 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:33.219160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:33.228366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda74f1b-18a4-4ba8-bbba-57714826db3f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:33.234140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd2a4e-1f68-4bb1-bf62-bae6a9f94c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:33.234847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2a4e-1f68-4bb1-bf62-bae6a9f94c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:33.235102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2a4e-1f68-4bb1-bf62-bae6a9f94c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:33.235356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2a4e-1f68-4bb1-bf62-bae6a9f94c73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:33.236220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd2a4e-1f68-4bb1-bf62-bae6a9f94c73 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=8300baf6ed2c4eba886c7740cbf7fab9, user.id=b2fc78a9276a4d32be82e54e7a8c49ff) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:33.236558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd2a4e-1f68-4bb1-bf62-bae6a9f94c73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:33.238500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd2a4e-1f68-4bb1-bf62-bae6a9f94c73 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:33.244930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 581/1159] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:33 2022] GET /identity/v3/role_assignments?user.id=b2fc78a9276a4d32be82e54e7a8c49ff&scope.project.id=8300baf6ed2c4eba886c7740cbf7fab9&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:35.702858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90c757-bf43-4751-908f-fbb27f81dc9c None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:35.703439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90c757-bf43-4751-908f-fbb27f81dc9c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:35.703534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90c757-bf43-4751-908f-fbb27f81dc9c None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:35.705515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 579/1160] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:35.711019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff54e-5f87-4fa7-8a1e-2ff03239e546 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:35.711524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff54e-5f87-4fa7-8a1e-2ff03239e546 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:35.711615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ff54e-5f87-4fa7-8a1e-2ff03239e546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:35.729452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a87ff54e-5f87-4fa7-8a1e-2ff03239e546 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:35.731218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a87ff54e-5f87-4fa7-8a1e-2ff03239e546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:35.738977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 582/1161] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:35.762898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90c757-bf43-4751-908f-fbb27f81dc9c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:35.776104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90c757-bf43-4751-908f-fbb27f81dc9c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:35.781259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:35.781931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:35.782216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:35.782490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:35.791238 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:35.793898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:35.803171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 580/1162] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:35.810263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ff54e-5f87-4fa7-8a1e-2ff03239e546 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:35.819884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ff54e-5f87-4fa7-8a1e-2ff03239e546 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:35.824484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9455d6-8ffc-4ad6-b59e-6052ad1662e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:35.825314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9455d6-8ffc-4ad6-b59e-6052ad1662e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:35.825600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9455d6-8ffc-4ad6-b59e-6052ad1662e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:35.825876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9455d6-8ffc-4ad6-b59e-6052ad1662e9 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:35.833435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9455d6-8ffc-4ad6-b59e-6052ad1662e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:35.835272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9455d6-8ffc-4ad6-b59e-6052ad1662e9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:35.852232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-0b9455d6-8ffc-4ad6-b59e-6052ad1662e9 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 16 18:02:35.853476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 583/1163] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:02:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:35.860322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:35.869278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafef2e-33f2-4ddb-bcc8-6b9826aedbac admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:35.874265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377db59c-bb25-452b-a353-4b14d017bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:35.874927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db59c-bb25-452b-a353-4b14d017bbbc admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:35.875213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db59c-bb25-452b-a353-4b14d017bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:35.875491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377db59c-bb25-452b-a353-4b14d017bbbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:35.876208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377db59c-bb25-452b-a353-4b14d017bbbc admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:35.876514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377db59c-bb25-452b-a353-4b14d017bbbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:35.878143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377db59c-bb25-452b-a353-4b14d017bbbc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:35.885889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 581/1164] 10.222.0.87 () {56 vars in 1136 bytes} [Wed Feb 16 18:02:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:38.197892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b992d-df28-4d32-a7aa-bae0a5e26b4c None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:38.197892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b992d-df28-4d32-a7aa-bae0a5e26b4c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:38.198356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b992d-df28-4d32-a7aa-bae0a5e26b4c None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:38.199909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 584/1165] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:38.205806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b3053-b208-4ede-9683-ba04bc5e9c6e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:38.206323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b3053-b208-4ede-9683-ba04bc5e9c6e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:38.206414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b3053-b208-4ede-9683-ba04bc5e9c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:38.225810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f03b3053-b208-4ede-9683-ba04bc5e9c6e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:38.227013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f03b3053-b208-4ede-9683-ba04bc5e9c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:38.235615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 582/1166] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:38.259266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b992d-df28-4d32-a7aa-bae0a5e26b4c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:38.271472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b992d-df28-4d32-a7aa-bae0a5e26b4c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:38.275828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f19e91-15d6-4c31-9d19-7bce6f63f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:38.276477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f19e91-15d6-4c31-9d19-7bce6f63f32f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:38.277311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f19e91-15d6-4c31-9d19-7bce6f63f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:38.277588 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f19e91-15d6-4c31-9d19-7bce6f63f32f admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:38.278333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f19e91-15d6-4c31-9d19-7bce6f63f32f admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:38.279356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-45f19e91-15d6-4c31-9d19-7bce6f63f32f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:02:38.279356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:02:38.279356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:02:38.280215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f19e91-15d6-4c31-9d19-7bce6f63f32f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:38.357098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 585/1167] 10.222.0.87 () {60 vars in 1159 bytes} [Wed Feb 16 18:02:38 2022] POST /identity/v3/domains => generated 267 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:02:40.752309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bb9bd-4b46-4be2-8696-b88b0fbe8421 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:40.752869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bb9bd-4b46-4be2-8696-b88b0fbe8421 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:40.752869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bb9bd-4b46-4be2-8696-b88b0fbe8421 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:40.754715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 583/1168] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:40.760007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdea22-11ac-4d3c-be9e-4f54104c5342 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:40.760410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdea22-11ac-4d3c-be9e-4f54104c5342 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:40.760561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdea22-11ac-4d3c-be9e-4f54104c5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:40.780169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9cbdea22-11ac-4d3c-be9e-4f54104c5342 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:40.781393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9cbdea22-11ac-4d3c-be9e-4f54104c5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:40.839311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 586/1169] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:40.863457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bb9bd-4b46-4be2-8696-b88b0fbe8421 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:40.876086 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bb9bd-4b46-4be2-8696-b88b0fbe8421 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:40.880607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed124-7528-47b2-a041-03cbe0dec91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:40.881491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed124-7528-47b2-a041-03cbe0dec91c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:40.881774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed124-7528-47b2-a041-03cbe0dec91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:40.882047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed124-7528-47b2-a041-03cbe0dec91c admin admin] PATH_INFO: `/v3/domains/9ae03d9dafe442bcafe8a7468bb7b445` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:40.893824 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed124-7528-47b2-a041-03cbe0dec91c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=9ae03d9dafe442bcafe8a7468bb7b445)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:40.895807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed124-7528-47b2-a041-03cbe0dec91c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:40.897567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 584/1170] 10.222.0.87 () {56 vars in 1204 bytes} [Wed Feb 16 18:02:40 2022] GET /identity/v3/domains/9ae03d9dafe442bcafe8a7468bb7b445 => generated 267 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:40.904278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdea22-11ac-4d3c-be9e-4f54104c5342 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:40.913147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdea22-11ac-4d3c-be9e-4f54104c5342 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:40.917976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3f85f-472b-4b68-9b1b-4de23248e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:40.918386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f85f-472b-4b68-9b1b-4de23248e8fe admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:40.918665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f85f-472b-4b68-9b1b-4de23248e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:40.918938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3f85f-472b-4b68-9b1b-4de23248e8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:40.921732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f85f-472b-4b68-9b1b-4de23248e8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:40.923668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3f85f-472b-4b68-9b1b-4de23248e8fe admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:41.036788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 587/1171] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:02:40 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:02:43.439688 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2054da-e836-4fdc-8c2f-91fa5b35e80e None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:43.440461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2054da-e836-4fdc-8c2f-91fa5b35e80e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:43.440461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2054da-e836-4fdc-8c2f-91fa5b35e80e None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:43.442063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 585/1172] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:43.447714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b35a6-20a7-4a9b-b121-4d56ce47dd40 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:43.448250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b35a6-20a7-4a9b-b121-4d56ce47dd40 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:43.448250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b35a6-20a7-4a9b-b121-4d56ce47dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:43.469571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-4b2b35a6-20a7-4a9b-b121-4d56ce47dd40 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:43.470798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4b2b35a6-20a7-4a9b-b121-4d56ce47dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:43.529833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 588/1173] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:43.555293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2054da-e836-4fdc-8c2f-91fa5b35e80e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:43.567571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2054da-e836-4fdc-8c2f-91fa5b35e80e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:43.572046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d4cfa-2c20-450d-b43c-aa8a38435b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:43.572890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d4cfa-2c20-450d-b43c-aa8a38435b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:43.573206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d4cfa-2c20-450d-b43c-aa8a38435b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:43.573485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d4cfa-2c20-450d-b43c-aa8a38435b50 admin admin] PATH_INFO: `/v3/domains/9ae03d9dafe442bcafe8a7468bb7b445` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:43.574694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d4cfa-2c20-450d-b43c-aa8a38435b50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=9ae03d9dafe442bcafe8a7468bb7b445)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:43.576617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d4cfa-2c20-450d-b43c-aa8a38435b50 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:43.578263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 586/1174] 10.222.0.87 () {56 vars in 1204 bytes} [Wed Feb 16 18:02:43 2022] GET /identity/v3/domains/9ae03d9dafe442bcafe8a7468bb7b445 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:43.584176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b35a6-20a7-4a9b-b121-4d56ce47dd40 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:43.593904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b35a6-20a7-4a9b-b121-4d56ce47dd40 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:43.598442 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6551871-2361-43cd-bf93-8c09a500a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:43.599098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551871-2361-43cd-bf93-8c09a500a4af admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:43.599381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551871-2361-43cd-bf93-8c09a500a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:43.599657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551871-2361-43cd-bf93-8c09a500a4af admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:43.600372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6551871-2361-43cd-bf93-8c09a500a4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:43.602352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6551871-2361-43cd-bf93-8c09a500a4af admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:43.753776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 589/1175] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:02:43 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:02:46.187974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7468-6476-42f8-9a1d-ae28000e2683 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.188531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7468-6476-42f8-9a1d-ae28000e2683 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.188531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7468-6476-42f8-9a1d-ae28000e2683 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.190352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 587/1176] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:46.195644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178539-1680-45e3-9d49-60f1e6e3a9e8 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.196079 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178539-1680-45e3-9d49-60f1e6e3a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.196213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a178539-1680-45e3-9d49-60f1e6e3a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.215407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9a178539-1680-45e3-9d49-60f1e6e3a9e8 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:46.216603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9a178539-1680-45e3-9d49-60f1e6e3a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:46.224251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 590/1177] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:46.248181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab7468-6476-42f8-9a1d-ae28000e2683 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:46.260067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab7468-6476-42f8-9a1d-ae28000e2683 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:46.265906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:46.266692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.266980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.267258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.279414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:46.286416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:46.287577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 588/1178] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:46.293678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178539-1680-45e3-9d49-60f1e6e3a9e8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:46.302642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a178539-1680-45e3-9d49-60f1e6e3a9e8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:46.307406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:46.308613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.309036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.309168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.309900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:46.310204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:46.311790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:46.319892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 591/1179] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:02:46.326324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:46.335974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63bac-3f1c-4d00-81af-f5cde3b61210 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:46.340902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:46.341794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.342080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.342359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] PATH_INFO: `/v3/users/db9fc395d3dd4babab7fdd3e16280df6` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.355697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] RBAC: Authorizing `identity:get_user(user_id=db9fc395d3dd4babab7fdd3e16280df6)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:46.357900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:46.359637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 589/1180] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:46 2022] GET /identity/v3/users/db9fc395d3dd4babab7fdd3e16280df6 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:46.365642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:46.376031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349e163-8e47-4594-8e8c-82425de44d34 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:46.380563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:46.381272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.381558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.381836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.390349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:46.392089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:46.400825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 592/1181] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:46.406938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:46.416801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa202-9163-432f-997a-a247a832bf61 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:46.421829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da396d3b-2e63-4d61-9e58-51d5a1a68047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:46.422688 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396d3b-2e63-4d61-9e58-51d5a1a68047 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.422975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396d3b-2e63-4d61-9e58-51d5a1a68047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.423253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396d3b-2e63-4d61-9e58-51d5a1a68047 admin admin] PATH_INFO: `/v3/projects/fabb252751984517bdaf7fd5fbfe4049` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.424413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da396d3b-2e63-4d61-9e58-51d5a1a68047 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabb252751984517bdaf7fd5fbfe4049)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:46.426578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da396d3b-2e63-4d61-9e58-51d5a1a68047 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:46.428259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 590/1182] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:46 2022] GET /identity/v3/projects/fabb252751984517bdaf7fd5fbfe4049 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:46.435275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:46.444258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd42fe-55fb-4a82-9210-a9fd22a85896 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:46.453048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fe6dc-fbaf-4f4d-adcc-8a9ed2cbd016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:46.453733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fe6dc-fbaf-4f4d-adcc-8a9ed2cbd016 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:46.454019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fe6dc-fbaf-4f4d-adcc-8a9ed2cbd016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:46.454300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fe6dc-fbaf-4f4d-adcc-8a9ed2cbd016 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:46.455130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fe6dc-fbaf-4f4d-adcc-8a9ed2cbd016 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=fabb252751984517bdaf7fd5fbfe4049, user.id=db9fc395d3dd4babab7fdd3e16280df6) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:46.455450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fe6dc-fbaf-4f4d-adcc-8a9ed2cbd016 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:46.457373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fe6dc-fbaf-4f4d-adcc-8a9ed2cbd016 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:46.463376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 593/1183] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:46 2022] GET /identity/v3/role_assignments?user.id=db9fc395d3dd4babab7fdd3e16280df6&scope.project.id=fabb252751984517bdaf7fd5fbfe4049&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:48.770502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275cbdb-9170-4d10-aa46-2a89e00e9542 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:48.771132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275cbdb-9170-4d10-aa46-2a89e00e9542 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:48.771132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275cbdb-9170-4d10-aa46-2a89e00e9542 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:48.772851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 591/1184] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:48.779297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03facceb-4fc0-4174-bbc1-147d27aad22b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:48.779781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03facceb-4fc0-4174-bbc1-147d27aad22b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:48.779961 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03facceb-4fc0-4174-bbc1-147d27aad22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:48.800539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-03facceb-4fc0-4174-bbc1-147d27aad22b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:48.801987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-03facceb-4fc0-4174-bbc1-147d27aad22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:48.811444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 594/1185] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:02:48.838632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275cbdb-9170-4d10-aa46-2a89e00e9542 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:48.854407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275cbdb-9170-4d10-aa46-2a89e00e9542 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:48.860514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:48.861527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:48.861885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:48.862232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:48.874726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:48.883377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:48.885010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 592/1186] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:48.891438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03facceb-4fc0-4174-bbc1-147d27aad22b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:48.900380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03facceb-4fc0-4174-bbc1-147d27aad22b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:48.905732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:48.906392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:48.906679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:48.906958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:48.907700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:48.908009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:48.909639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:48.918913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 595/1187] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:48.924721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:48.935192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5351a-081a-4c37-9d3a-aa3ea7066f01 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:48.939741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:48.940603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:48.940882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:48.941272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] PATH_INFO: `/v3/users/db9fc395d3dd4babab7fdd3e16280df6` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:48.942443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] RBAC: Authorizing `identity:get_user(user_id=db9fc395d3dd4babab7fdd3e16280df6)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:48.944547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:48.946186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 593/1188] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:48 2022] GET /identity/v3/users/db9fc395d3dd4babab7fdd3e16280df6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:48.952447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:48.962372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094177c-f90c-4d51-b484-4bf57539434b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:48.967847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b55e-ef78-4dfc-8a74-05ff7c0985a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:48.968696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b55e-ef78-4dfc-8a74-05ff7c0985a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:48.969017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b55e-ef78-4dfc-8a74-05ff7c0985a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:48.969336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b55e-ef78-4dfc-8a74-05ff7c0985a9 admin admin] PATH_INFO: `/v3/projects/fabb252751984517bdaf7fd5fbfe4049` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:48.970514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b55e-ef78-4dfc-8a74-05ff7c0985a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabb252751984517bdaf7fd5fbfe4049)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:48.972551 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0b55e-ef78-4dfc-8a74-05ff7c0985a9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:48.974265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 596/1189] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:48 2022] GET /identity/v3/projects/fabb252751984517bdaf7fd5fbfe4049 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:48.983656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:48.995491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067122d4-6872-4d4a-8410-2e5b6cb2434f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:49.000874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf153407-2c93-4ebf-bc2b-66bfe0655b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:49.001934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf153407-2c93-4ebf-bc2b-66bfe0655b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:49.002222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf153407-2c93-4ebf-bc2b-66bfe0655b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:49.002557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf153407-2c93-4ebf-bc2b-66bfe0655b3c admin admin] PATH_INFO: `/v3/projects/fabb252751984517bdaf7fd5fbfe4049/users/db9fc395d3dd4babab7fdd3e16280df6/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:49.004816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf153407-2c93-4ebf-bc2b-66bfe0655b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabb252751984517bdaf7fd5fbfe4049, user_id=db9fc395d3dd4babab7fdd3e16280df6, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:49.008003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf153407-2c93-4ebf-bc2b-66bfe0655b3c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:49.108067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 594/1190] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:02:48 2022] PUT /identity/v3/projects/fabb252751984517bdaf7fd5fbfe4049/users/db9fc395d3dd4babab7fdd3e16280df6/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:02:51.426433 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670335be-e2f6-4607-8335-0139d4f0d6ac None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.426991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670335be-e2f6-4607-8335-0139d4f0d6ac None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.426991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670335be-e2f6-4607-8335-0139d4f0d6ac None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.428923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 597/1191] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:02:51.434749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd061-fa04-4fc1-b7ac-343c73a11037 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.435182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd061-fa04-4fc1-b7ac-343c73a11037 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.435290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd061-fa04-4fc1-b7ac-343c73a11037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.452940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d5ddd061-fa04-4fc1-b7ac-343c73a11037 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:02:51.454103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d5ddd061-fa04-4fc1-b7ac-343c73a11037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:02:51.509718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 595/1192] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:02:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:02:51.535586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670335be-e2f6-4607-8335-0139d4f0d6ac None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:51.547894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670335be-e2f6-4607-8335-0139d4f0d6ac None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:51.552673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:51.553917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.554369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.555107 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.572718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:02:51.586153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:02:51.587366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 598/1193] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:02:51.593617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd061-fa04-4fc1-b7ac-343c73a11037 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:51.602473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd061-fa04-4fc1-b7ac-343c73a11037 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:51.607303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:51.607975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.608253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.608524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.609306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:51.609610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:51.611192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:51.620821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 596/1194] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:51.630613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:51.647753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80dd37-9133-43d8-8d23-91fe63553b57 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:51.657491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:51.658359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.658647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.658927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] PATH_INFO: `/v3/users/db9fc395d3dd4babab7fdd3e16280df6` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.660127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=db9fc395d3dd4babab7fdd3e16280df6)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:51.662293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:51.663903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 599/1195] 10.222.0.87 () {56 vars in 1198 bytes} [Wed Feb 16 18:02:51 2022] GET /identity/v3/users/db9fc395d3dd4babab7fdd3e16280df6 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:51.671619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:51.681586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461a10-e0fe-46b4-8c88-e95a10529f17 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:51.686927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:51.687565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.687851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.688129 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.695863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:51.697633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:51.707398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 597/1196] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:02:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:02:51.713391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:51.723551 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8b14-af66-4a82-bdfd-23ab5b0630f0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:51.727979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70821c6a-2600-4a75-80db-0c1c09bfb736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:51.728808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70821c6a-2600-4a75-80db-0c1c09bfb736 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.729107 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70821c6a-2600-4a75-80db-0c1c09bfb736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.729387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70821c6a-2600-4a75-80db-0c1c09bfb736 admin admin] PATH_INFO: `/v3/projects/fabb252751984517bdaf7fd5fbfe4049` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.730965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70821c6a-2600-4a75-80db-0c1c09bfb736 admin admin] RBAC: Authorizing `identity:get_project(project_id=fabb252751984517bdaf7fd5fbfe4049)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:51.732972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70821c6a-2600-4a75-80db-0c1c09bfb736 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:51.734628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 600/1197] 10.222.0.87 () {56 vars in 1207 bytes} [Wed Feb 16 18:02:51 2022] GET /identity/v3/projects/fabb252751984517bdaf7fd5fbfe4049 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:02:51.740471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:02:51.750092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc768-75ab-484d-b842-02d950a4dbc0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:02:51.754625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147030d-ac01-4cb8-b62e-2617515adc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:02:51.755253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147030d-ac01-4cb8-b62e-2617515adc33 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:02:51.755538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147030d-ac01-4cb8-b62e-2617515adc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:02:51.755815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147030d-ac01-4cb8-b62e-2617515adc33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:02:51.756626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147030d-ac01-4cb8-b62e-2617515adc33 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=fabb252751984517bdaf7fd5fbfe4049, user.id=db9fc395d3dd4babab7fdd3e16280df6) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:02:51.756934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147030d-ac01-4cb8-b62e-2617515adc33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:02:51.758790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147030d-ac01-4cb8-b62e-2617515adc33 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:02:51.765089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 598/1198] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:02:51 2022] GET /identity/v3/role_assignments?user.id=db9fc395d3dd4babab7fdd3e16280df6&scope.project.id=fabb252751984517bdaf7fd5fbfe4049&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:16.682599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c40e2-fb3e-423d-90bf-c78914f21d8e None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:16.683353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c40e2-fb3e-423d-90bf-c78914f21d8e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:16.683353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c40e2-fb3e-423d-90bf-c78914f21d8e None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:16.685150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 601/1199] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:16.693022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188407cc-2202-43d2-bcbb-99e29e31635b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:16.699632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188407cc-2202-43d2-bcbb-99e29e31635b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:16.699632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188407cc-2202-43d2-bcbb-99e29e31635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:16.718581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-188407cc-2202-43d2-bcbb-99e29e31635b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:16.719852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-188407cc-2202-43d2-bcbb-99e29e31635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:16.728210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 599/1200] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:16.755274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c40e2-fb3e-423d-90bf-c78914f21d8e None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:16.768364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c40e2-fb3e-423d-90bf-c78914f21d8e None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:16.772856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:16.773669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:16.773952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:16.774303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:16.785626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:16.789147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:16.804010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:16.805178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 602/1201] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:16.813564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188407cc-2202-43d2-bcbb-99e29e31635b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:16.827059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188407cc-2202-43d2-bcbb-99e29e31635b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:16.831856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259377c-de65-4318-9e57-1463b564565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:16.832508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259377c-de65-4318-9e57-1463b564565c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:16.837397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259377c-de65-4318-9e57-1463b564565c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:16.837397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259377c-de65-4318-9e57-1463b564565c admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:16.837397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259377c-de65-4318-9e57-1463b564565c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:16.837397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259377c-de65-4318-9e57-1463b564565c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:16.837397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259377c-de65-4318-9e57-1463b564565c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:16.848230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 600/1202] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:16.855583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:16.869776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefba1c-ee00-4878-a28d-437447f0f108 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:16.876517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44845047-5245-4e49-8362-907a1a86e048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:16.877465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845047-5245-4e49-8362-907a1a86e048 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:16.877810 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845047-5245-4e49-8362-907a1a86e048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:16.878207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44845047-5245-4e49-8362-907a1a86e048 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:16.879062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44845047-5245-4e49-8362-907a1a86e048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:16.881352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44845047-5245-4e49-8362-907a1a86e048 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:16.972647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 603/1203] 10.222.0.87 () {60 vars in 1153 bytes} [Wed Feb 16 18:04:16 2022] POST /identity/v3/users => generated 251 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:04:19.410589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7da404-1570-4318-8aed-a61ae495387c None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.411147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7da404-1570-4318-8aed-a61ae495387c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.411147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7da404-1570-4318-8aed-a61ae495387c None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.412960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 601/1204] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:19.418338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10c6d5-0991-4c16-9e9f-b39a014c9197 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.418797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10c6d5-0991-4c16-9e9f-b39a014c9197 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.418907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10c6d5-0991-4c16-9e9f-b39a014c9197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.438223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7a10c6d5-0991-4c16-9e9f-b39a014c9197 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:19.439440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7a10c6d5-0991-4c16-9e9f-b39a014c9197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:19.447346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 604/1205] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:19.471793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7da404-1570-4318-8aed-a61ae495387c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.484431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7da404-1570-4318-8aed-a61ae495387c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.488876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.489691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.489972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.490249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.501746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:04:19.509920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:04:19.511730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 602/1206] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:04:19.517841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10c6d5-0991-4c16-9e9f-b39a014c9197 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.527209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10c6d5-0991-4c16-9e9f-b39a014c9197 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.531808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.532787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.532787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.533152 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.533904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:19.534217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.535903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.545288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 605/1207] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:04:19.550798 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.561513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a15d-d73b-48a6-b573-2560918a5c16 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.566004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.566778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.567062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.567342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.578261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.580064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.597035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:19.598244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 603/1208] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:19.604976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.617137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5ddce-445f-4e85-a9a9-eaa70464a1e0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.625031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.626113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.626585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.627061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.628330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:19.628855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.631665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.648782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 606/1209] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:19.655496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.671877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5c821-5d53-4930-a4b9-792248e55fac admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.679139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.680421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.680883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.681355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.692471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.694500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.709061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 18:04:19.710185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 604/1210] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:19.716391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.726317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf744e2-8a94-4437-8f9d-e2734c055a47 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.731180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.731993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.732274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.732549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.733469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:19.733783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.735627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.753949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 607/1211] 10.222.0.87 () {56 vars in 1164 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:04:19.759771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.770414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d6ef-2931-43a0-9fdc-24e0a3559c0f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.775108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.775746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.776024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.776297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.784384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.786143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.796059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 605/1212] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:04:19.802219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.812963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a082e-ec1c-4746-bb5b-86a4e50371ca admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.817660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.818450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.818731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.819002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.829787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.831712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.856151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:19.857888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 608/1213] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:19.864453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.874443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7149c-32bc-40b2-b2bb-75902c41591b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.879233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.879890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.880173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.880447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.881187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:19.881492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.883062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.895514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 606/1214] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:19.901144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.911804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6893d8-df91-4876-8eb3-6ef71e6a3e8a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.916530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.918534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.919747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.920042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.927366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.929437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.944393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:04:19.945786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 609/1215] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:19.952654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:19.965881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cb1ed-178f-4b46-90c4-9b8c9cca90e4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:19.977022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a412-82a6-48e5-94c7-6b9239043fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:19.977723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a412-82a6-48e5-94c7-6b9239043fda admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:19.978011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a412-82a6-48e5-94c7-6b9239043fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:19.978291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a412-82a6-48e5-94c7-6b9239043fda admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:19.979082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a412-82a6-48e5-94c7-6b9239043fda admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:19.979396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a412-82a6-48e5-94c7-6b9239043fda admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:19.982441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a412-82a6-48e5-94c7-6b9239043fda admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:19.995473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 607/1216] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:20.002580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:20.013406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352994-6c8f-4b10-ab43-e20612a03d0b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:20.018062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557b40e-361b-410d-aeac-90ab35af5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:20.018711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557b40e-361b-410d-aeac-90ab35af5f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:20.018996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557b40e-361b-410d-aeac-90ab35af5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:20.019273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557b40e-361b-410d-aeac-90ab35af5f50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:20.020099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557b40e-361b-410d-aeac-90ab35af5f50 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=6b08679e2a634bf08a279b6d8a9ffc46) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:20.020412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557b40e-361b-410d-aeac-90ab35af5f50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:20.022321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557b40e-361b-410d-aeac-90ab35af5f50 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:20.028660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 610/1217] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:04:20 2022] GET /identity/v3/role_assignments?user.id=6b08679e2a634bf08a279b6d8a9ffc46&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:22.410848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984846-c9e1-4558-955a-4bdb846d375d None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.411439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984846-c9e1-4558-955a-4bdb846d375d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.411439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984846-c9e1-4558-955a-4bdb846d375d None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.413363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 608/1218] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:22.420177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1bc-a016-4059-8f9e-03995a6f6f9b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.420811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1bc-a016-4059-8f9e-03995a6f6f9b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.420811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1bc-a016-4059-8f9e-03995a6f6f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.438903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-fd42d1bc-a016-4059-8f9e-03995a6f6f9b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:22.440081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fd42d1bc-a016-4059-8f9e-03995a6f6f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:22.447825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 611/1219] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:04:22.470948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984846-c9e1-4558-955a-4bdb846d375d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.483403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984846-c9e1-4558-955a-4bdb846d375d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.487767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.488555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.488834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.489127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.500371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:04:22.507373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:04:22.508562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 609/1220] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:22.515596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42d1bc-a016-4059-8f9e-03995a6f6f9b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.525839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42d1bc-a016-4059-8f9e-03995a6f6f9b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.531552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.532230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.532516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.532886 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.533713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:22.534035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.535793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.545607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 612/1221] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:22.551607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.563195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7ce2-abcd-4699-8f07-4fadfcdfc400 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.568163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.568970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.569322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.569609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.581195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.583038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.600280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:22.601513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 610/1222] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:04:22.608173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.618154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88305128-e2e6-4621-bf4e-a30ab09e9b18 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.624181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.624850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.625167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.625448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.626171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:22.626530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.628149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.642054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 613/1223] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:22.647928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.659563 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97d133-6011-4eb4-8e3b-3c7a46ab4bba admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.664281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.665104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.665399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.665674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.674271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.676283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.692331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 18:04:22.693571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 611/1224] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:22.700733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.710597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3ad2-b938-4f3f-9885-0ef89f8c7def admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.716201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.718637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.718637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.718637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.718637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:22.718637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.720475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.740052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 614/1225] 10.222.0.87 () {56 vars in 1164 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:22.746245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.757374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45574cd8-8baa-4212-ac08-29eb5b385045 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.765205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.765814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.766099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.766375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.777407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.779251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.798642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:22.799860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 612/1226] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:22.805986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.817470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c710406-d5a1-4694-987f-1a5acdb377d3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.822280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.822965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.823254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.823692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.824932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:22.825314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.827024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.839082 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 615/1227] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:22.844738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.854479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e87c6-7cba-4e2a-bdbc-aa89bd9ae532 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.859742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.860577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.860858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.861157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.868483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.871042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.884538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:04:22.885798 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 613/1228] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:22.892235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.902586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d39254-97e9-4c6e-bdee-454c3f0aa5a4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.907389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdffc1-4768-4f52-b08e-385c62bfc7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.908082 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdffc1-4768-4f52-b08e-385c62bfc7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.908359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdffc1-4768-4f52-b08e-385c62bfc7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.908630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdffc1-4768-4f52-b08e-385c62bfc7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.909480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdffc1-4768-4f52-b08e-385c62bfc7f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:22.909790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdffc1-4768-4f52-b08e-385c62bfc7f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.911650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdffc1-4768-4f52-b08e-385c62bfc7f6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:22.925770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 616/1229] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:22.933484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:22.943968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3173-cc3d-4cc5-bde0-1b6d3d3ea02e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:22.948555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54977c96-8410-4350-bd7b-e0486d4addd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:22.949532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977c96-8410-4350-bd7b-e0486d4addd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:22.949813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977c96-8410-4350-bd7b-e0486d4addd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:22.950084 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977c96-8410-4350-bd7b-e0486d4addd1 admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/6b08679e2a634bf08a279b6d8a9ffc46/roles/103afb794083469bba2437eec01fd04b` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:22.964628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54977c96-8410-4350-bd7b-e0486d4addd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=6b08679e2a634bf08a279b6d8a9ffc46, role_id=103afb794083469bba2437eec01fd04b)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:22.967207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54977c96-8410-4350-bd7b-e0486d4addd1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:23.057552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 614/1230] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:04:22 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/6b08679e2a634bf08a279b6d8a9ffc46/roles/103afb794083469bba2437eec01fd04b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:04:25.376495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0a15d-1402-41e8-82ba-704725a8d4f0 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.377125 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0a15d-1402-41e8-82ba-704725a8d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.377125 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0a15d-1402-41e8-82ba-704725a8d4f0 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.378877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 617/1231] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:25.384362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac324a-71de-4912-b3aa-f642fd10a0ae None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.384840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac324a-71de-4912-b3aa-f642fd10a0ae None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.384932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac324a-71de-4912-b3aa-f642fd10a0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.403936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-49ac324a-71de-4912-b3aa-f642fd10a0ae None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:25.405178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-49ac324a-71de-4912-b3aa-f642fd10a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:25.462480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 615/1232] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:25.488619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0a15d-1402-41e8-82ba-704725a8d4f0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.502361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0a15d-1402-41e8-82ba-704725a8d4f0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.506823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.507625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.507908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.508193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.519524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:04:25.527816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 18:04:25.529042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 618/1233] 10.222.0.87 () {56 vars in 1123 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:25.535517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac324a-71de-4912-b3aa-f642fd10a0ae None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.545530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac324a-71de-4912-b3aa-f642fd10a0ae None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.550551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.551227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.551512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.551790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.552613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:25.552921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.554547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.564108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 616/1234] 10.222.0.87 () {56 vars in 1124 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:25.570236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.581159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d9b62-8a95-4d93-8bf2-3c73cf0b6d67 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.585618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.586402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.586666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.586937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.597645 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.599459 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.616963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:25.618202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 619/1235] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:25.624596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.634702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c760fc-59d5-4f38-86b8-1c8657258cf1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.639645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.640306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.645325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.645325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.645325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:25.645325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.645325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.656314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 617/1236] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:25.662126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.672806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb43a7-0881-4bbd-b4a5-2661e517df30 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.677420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.678229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.678511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.678789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.687034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.689059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.703861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 18:04:25.705070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 620/1237] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:04:25.711088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.722029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e11c38-5d6f-4fbd-a677-d9cdf0b07362 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.727165 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.727833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.728903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.728903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.729262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:25.730195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.732233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.760701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 618/1238] 10.222.0.87 () {56 vars in 1164 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:25.767215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.778240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae61ae-a4c8-45f8-8424-7dff4f827d47 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.783003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.783655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.783935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.784204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.793643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.803623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.809849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 621/1239] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:04:25.816082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.826683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4252a-3801-4caf-9370-74b3c0529012 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.831562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.832398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.832675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.832944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.844618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.846481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.863692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:25.864903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 619/1240] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:25.871463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.881328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e471f3-bcbf-422b-b078-43362c76b1ab admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.886774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.887440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.887794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.888071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.888786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:25.889103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.890760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.903163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 622/1241] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:25.909021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.919323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc7803-e61c-4381-9111-e9ea87559801 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.923998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.926335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.926335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.926335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.932980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.935154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.949207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:04:25.950536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 620/1242] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:25.956546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:25.966841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605eacf-7a6e-4b2d-8085-bb6dcfd12046 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:25.972662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473186a-985d-4e87-97a7-a4de2ac036c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:25.973300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473186a-985d-4e87-97a7-a4de2ac036c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:25.973588 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473186a-985d-4e87-97a7-a4de2ac036c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:25.973866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473186a-985d-4e87-97a7-a4de2ac036c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:25.974739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473186a-985d-4e87-97a7-a4de2ac036c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:25.974959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473186a-985d-4e87-97a7-a4de2ac036c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:25.976823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473186a-985d-4e87-97a7-a4de2ac036c4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:25.989523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 623/1243] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:25.995969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:26.006294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79a64c-cf6a-43ba-a7aa-2963f3d89ee5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:26.011591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97d6af-8a0a-428b-9cbb-12d9e7347b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:26.012648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97d6af-8a0a-428b-9cbb-12d9e7347b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:26.012648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97d6af-8a0a-428b-9cbb-12d9e7347b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:26.012834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97d6af-8a0a-428b-9cbb-12d9e7347b97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:26.013661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97d6af-8a0a-428b-9cbb-12d9e7347b97 admin admin] RBAC: Adding query filter params (role.id=103afb794083469bba2437eec01fd04b, scope.project.id=578059b701674f41b39442d2a018b489, user.id=6b08679e2a634bf08a279b6d8a9ffc46) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:26.013970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97d6af-8a0a-428b-9cbb-12d9e7347b97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:26.015816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97d6af-8a0a-428b-9cbb-12d9e7347b97 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:26.026059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 621/1244] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:04:25 2022] GET /identity/v3/role_assignments?user.id=6b08679e2a634bf08a279b6d8a9ffc46&scope.project.id=578059b701674f41b39442d2a018b489&role.id=103afb794083469bba2437eec01fd04b => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:28.436501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce9c4-74b6-410e-aadd-839815d7284c None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.437060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce9c4-74b6-410e-aadd-839815d7284c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.437060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ce9c4-74b6-410e-aadd-839815d7284c None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.438851 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 624/1245] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:28.444357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908a66-ab96-42b1-8747-30bcd89223a7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.444803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908a66-ab96-42b1-8747-30bcd89223a7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.444911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908a66-ab96-42b1-8747-30bcd89223a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.462426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ed908a66-ab96-42b1-8747-30bcd89223a7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:28.463559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ed908a66-ab96-42b1-8747-30bcd89223a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:28.472272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 622/1246] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:28.496890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce9c4-74b6-410e-aadd-839815d7284c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.509929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ce9c4-74b6-410e-aadd-839815d7284c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.514525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.515327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.515614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.515893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.527093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:04:28.534443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:04:28.535697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 625/1247] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:28.541941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908a66-ab96-42b1-8747-30bcd89223a7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.551869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908a66-ab96-42b1-8747-30bcd89223a7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.556390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.557049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.557688 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.557963 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.558697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:28.558996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.560567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.569914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 623/1248] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:28.576094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.586309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9c4af-4fc9-4c63-8ac3-2e399da1b1da admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.592184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.592978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.593290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.593569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.604055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.606529 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.623494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:28.624695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 626/1249] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:04:28.630648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.640630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de068a-b36a-4c6f-a5fe-c40131fd0a8a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.645273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.645942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.646228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.646506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.647226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:28.647536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.649161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.662237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 624/1250] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:28.669046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.679504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea1889-fab5-4c09-aac3-2cb465f6c250 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.684619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.685609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.685924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.686204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.694265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.696366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.711288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 18:04:28.713009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 627/1251] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:28.719508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.729302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69addf7-9eed-47d1-a727-1538f1c7fedd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.734979 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.735657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.735940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.736217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.737054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:28.737403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.739283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.758481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 625/1252] 10.222.0.87 () {56 vars in 1164 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:28.765247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.777327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abd046-2e88-4d0a-aabc-ee44217880b6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.782412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.783057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.783341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.783614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.793216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.795079 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.804988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 628/1253] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:04:28.811546 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.821664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685262-e3fa-4a99-9827-ffd4480793ad admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.827018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.827824 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.828130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.828426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.839755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.841811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.859405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:28.860574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 626/1254] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:28.866463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.876212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094e840-4127-460c-bf2c-37cb35132253 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.881205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.881625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.881910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.882178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.882891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:28.883194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.884822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.897782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 629/1255] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:28.904324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.914478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3547cc-04b0-41f1-a0ba-8fccd34a5ee6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.919144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.920072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.921472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.921472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.927987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.930462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.944547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:04:28.951245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 627/1256] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:28.952976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:28.963080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c5c55-25ab-4c1c-b9b8-4a129cfab2b9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:28.968473 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b53a44-ccb0-4159-bba5-858ceec9ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:28.969150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b53a44-ccb0-4159-bba5-858ceec9ed56 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:28.969455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b53a44-ccb0-4159-bba5-858ceec9ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:28.969722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b53a44-ccb0-4159-bba5-858ceec9ed56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:28.970491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b53a44-ccb0-4159-bba5-858ceec9ed56 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:28.970797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b53a44-ccb0-4159-bba5-858ceec9ed56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:28.972641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b53a44-ccb0-4159-bba5-858ceec9ed56 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:28.985836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 630/1257] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:28.992073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:29.004442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44813cf6-fe87-42bd-8a4e-5e3345cbbc87 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:29.008898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05218-d710-4d5d-8c0f-d24eb1e85579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:29.009694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05218-d710-4d5d-8c0f-d24eb1e85579 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:29.009971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05218-d710-4d5d-8c0f-d24eb1e85579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:29.010242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05218-d710-4d5d-8c0f-d24eb1e85579 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:29.011559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05218-d710-4d5d-8c0f-d24eb1e85579 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=578059b701674f41b39442d2a018b489, user.id=6b08679e2a634bf08a279b6d8a9ffc46) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:29.011871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05218-d710-4d5d-8c0f-d24eb1e85579 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:29.013755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05218-d710-4d5d-8c0f-d24eb1e85579 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:29.019569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 628/1258] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:04:28 2022] GET /identity/v3/role_assignments?user.id=6b08679e2a634bf08a279b6d8a9ffc46&scope.project.id=578059b701674f41b39442d2a018b489&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:31.343425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c833-f8a9-4c63-922f-b20981f6295a None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.344161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c833-f8a9-4c63-922f-b20981f6295a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.344161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c833-f8a9-4c63-922f-b20981f6295a None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.345764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 631/1259] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:31.352550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126844f-f696-4a08-807d-49b095bc7b0d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.353052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126844f-f696-4a08-807d-49b095bc7b0d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.353527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126844f-f696-4a08-807d-49b095bc7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.376418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6126844f-f696-4a08-807d-49b095bc7b0d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:31.377664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6126844f-f696-4a08-807d-49b095bc7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:31.387112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 629/1260] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:31.411097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c833-f8a9-4c63-922f-b20981f6295a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.426812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c833-f8a9-4c63-922f-b20981f6295a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.435020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.436358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.436834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.437455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.450987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:04:31.457337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:04:31.459215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 632/1261] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 18:04:31.464987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126844f-f696-4a08-807d-49b095bc7b0d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.474818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126844f-f696-4a08-807d-49b095bc7b0d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.479904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.481791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.481791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.481791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.482403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:31.482717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.484326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.493335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 630/1262] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:31.499720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.514854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aba31-4477-4dc0-b6ba-610328c21927 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.519824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.520622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.520905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.521220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.532699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.534630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.553338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:31.554808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 633/1263] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:31.561423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.571621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523072ae-be34-4c44-8dc4-ec5a312c8387 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.580601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.580601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.580601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.580601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.581027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:31.581027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.581476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.594684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 631/1264] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:31.600718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.611298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00835-19ae-4d1c-91e6-2374f49d0e5f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.615904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.616698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.616976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.617277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.626479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.628502 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.646339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 18:04:31.647571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 634/1265] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:31.653822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.663758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f7097-5d10-4a30-b8e9-9d6b01201d99 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.669356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.670026 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.673480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.673480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.673480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:31.673480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.673912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.694745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 632/1266] 10.222.0.87 () {56 vars in 1164 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:31.701637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.713028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c0df3-9e05-4b21-9f66-f371827032a3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.718209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.719016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.719300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.719577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.730811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.732666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.751228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:31.752482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 635/1267] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:31.761285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.770989 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c664-9d2d-48e4-9966-281cfa1ff8e0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.778151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.778151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.778151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.778151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.780513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:31.780513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.780513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.792627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 633/1268] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:31.798547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.809789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549afb-d8fa-4d6d-9430-5b29a4d43799 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.816595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.820523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.820523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.820523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.825794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.827843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.842135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:04:31.843441 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 636/1269] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:31.849676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.859992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6226a4-8983-4993-bbec-1a5f06ddf68f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.864606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fd3e5-a40e-4983-a060-df9bdbd909ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.865296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fd3e5-a40e-4983-a060-df9bdbd909ea admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.866419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fd3e5-a40e-4983-a060-df9bdbd909ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.866419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fd3e5-a40e-4983-a060-df9bdbd909ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.866687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fd3e5-a40e-4983-a060-df9bdbd909ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:31.866920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fd3e5-a40e-4983-a060-df9bdbd909ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.868757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fd3e5-a40e-4983-a060-df9bdbd909ea admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:31.882487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 634/1270] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:31.889144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:31.899898 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd93ffa-dfdb-4e49-9a87-76903a5d1b0c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:31.904730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f9e59-2143-4820-8179-79d3252c6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:31.905658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9e59-2143-4820-8179-79d3252c6ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:31.905935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9e59-2143-4820-8179-79d3252c6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:31.906200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9e59-2143-4820-8179-79d3252c6ff0 admin admin] PATH_INFO: `/v3/projects/578059b701674f41b39442d2a018b489/users/6b08679e2a634bf08a279b6d8a9ffc46/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:31.908395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f9e59-2143-4820-8179-79d3252c6ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578059b701674f41b39442d2a018b489, user_id=6b08679e2a634bf08a279b6d8a9ffc46, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:31.910988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f9e59-2143-4820-8179-79d3252c6ff0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:32.069051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 637/1271] 10.222.0.87 () {58 vars in 1460 bytes} [Wed Feb 16 18:04:31 2022] PUT /identity/v3/projects/578059b701674f41b39442d2a018b489/users/6b08679e2a634bf08a279b6d8a9ffc46/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:04:34.540728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767808-6461-44b0-8378-e8e40714f2b9 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.541272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767808-6461-44b0-8378-e8e40714f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.541363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a767808-6461-44b0-8378-e8e40714f2b9 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.543212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 635/1272] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:34.548745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec9782-d427-4581-98b2-624848b6ede9 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.549221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec9782-d427-4581-98b2-624848b6ede9 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.549323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec9782-d427-4581-98b2-624848b6ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.567940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-75ec9782-d427-4581-98b2-624848b6ede9 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:34.569172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-75ec9782-d427-4581-98b2-624848b6ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:34.633040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 638/1273] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:34.662251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767808-6461-44b0-8378-e8e40714f2b9 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:34.676225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a767808-6461-44b0-8378-e8e40714f2b9 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:34.681018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:34.681845 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.682388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.683957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.695120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 18:04:34.703746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 18:04:34.704987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 636/1274] 10.222.0.87 () {56 vars in 1117 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:34.711111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec9782-d427-4581-98b2-624848b6ede9 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:34.720442 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec9782-d427-4581-98b2-624848b6ede9 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:34.725069 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:34.725755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.726040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.726317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.727064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:34.727369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:34.729016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:34.738388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 639/1275] 10.222.0.87 () {56 vars in 1120 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:34.744412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:34.756901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7142fa-0849-4d8e-b4e4-a812d542df01 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:34.762846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:34.766241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.766241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.766241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.776334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:34.778483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:34.797638 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:34.798897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 637/1276] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:34.805060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:34.816340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b930f-8603-4f97-ad3f-a252dedcf5fc admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:34.821554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:34.822213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.822497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.822776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.823498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:34.823807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:34.825631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:34.837930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 640/1277] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:34.844282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:34.855300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23784f-90cf-4a41-89e9-6b462435b65a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:34.860552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:34.861510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.861796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.862071 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.871587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:34.877115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:34.891718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 18:04:34.892956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 638/1278] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:34.899172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:34.910108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec379-f048-4a1a-bf16-7570c1406c34 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:34.914968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:34.915650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.915936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.916213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.918049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:34.918533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:34.921839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:34.941881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 641/1279] 10.222.0.87 () {56 vars in 1164 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:34.947966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:34.958007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7d7f4-89cf-4f2e-9c87-d94fe377db8d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:34.962790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:34.963446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:34.963726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:34.964003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:34.972564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:34.974688 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:34.991680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 639/1280] 10.222.0.87 () {58 vars in 1324 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:04:34.998216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:35.008538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e3be0-7ce4-401a-9392-89194fffec22 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:35.013562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:35.014349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:35.014626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:35.014903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:35.025680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:35.027693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:35.046308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 18:04:35.047537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 642/1281] 10.222.0.87 () {56 vars in 1129 bytes} [Wed Feb 16 18:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:35.053585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:35.063962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9622e-d4f7-4965-be51-64743cb11ec2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:35.068697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:35.069408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:35.069695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:35.069969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:35.070683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:35.070987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:35.072560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:35.085142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 640/1282] 10.222.0.87 () {56 vars in 1130 bytes} [Wed Feb 16 18:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:35.091796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:35.101656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01890ed6-8437-4b40-a312-4be45dd2d74b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:35.106833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:35.107617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:35.107940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:35.108209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:35.118089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:35.118089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:35.132579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING keystone.server.flask.application [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 18:04:35.133795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 643/1283] 10.222.0.87 () {56 vars in 1132 bytes} [Wed Feb 16 18:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:35.140243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:35.156296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9cb7-8a93-4afd-8168-4f69d935ccf9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:35.161442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562147de-b8cf-4ff6-9d00-e886e63abec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:35.162107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562147de-b8cf-4ff6-9d00-e886e63abec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:35.162394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562147de-b8cf-4ff6-9d00-e886e63abec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:35.162669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562147de-b8cf-4ff6-9d00-e886e63abec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:35.163521 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562147de-b8cf-4ff6-9d00-e886e63abec9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:35.163858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562147de-b8cf-4ff6-9d00-e886e63abec9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:35.165737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562147de-b8cf-4ff6-9d00-e886e63abec9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:35.179819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 641/1284] 10.222.0.87 () {56 vars in 1169 bytes} [Wed Feb 16 18:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:35.186849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:35.197797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c7d01-8860-4ac1-a370-10219236a62f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:35.202747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dbce9-0ffd-4a78-bddd-17e4d794d527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:35.203397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dbce9-0ffd-4a78-bddd-17e4d794d527 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:35.203676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dbce9-0ffd-4a78-bddd-17e4d794d527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:35.203947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dbce9-0ffd-4a78-bddd-17e4d794d527 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:35.204818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391dbce9-0ffd-4a78-bddd-17e4d794d527 admin admin] RBAC: Adding query filter params (role.id=fe3a6b9f0c504a2e8a7ab838026036b5, scope.project.id=578059b701674f41b39442d2a018b489, user.id=6b08679e2a634bf08a279b6d8a9ffc46) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:35.205155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391dbce9-0ffd-4a78-bddd-17e4d794d527 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:35.206990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391dbce9-0ffd-4a78-bddd-17e4d794d527 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:35.213317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 644/1285] 10.222.0.87 () {56 vars in 1395 bytes} [Wed Feb 16 18:04:35 2022] GET /identity/v3/role_assignments?user.id=6b08679e2a634bf08a279b6d8a9ffc46&scope.project.id=578059b701674f41b39442d2a018b489&role.id=fe3a6b9f0c504a2e8a7ab838026036b5 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:37.571933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7b3b1-9005-4930-8213-8d6249b257a0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:37.572458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7b3b1-9005-4930-8213-8d6249b257a0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:37.572458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7b3b1-9005-4930-8213-8d6249b257a0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:37.574532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 642/1286] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:37.580207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f769b5-d5a6-4099-bc8a-54e244d8ef22 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:37.580697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f769b5-d5a6-4099-bc8a-54e244d8ef22 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:37.580925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f769b5-d5a6-4099-bc8a-54e244d8ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:37.599663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-96f769b5-d5a6-4099-bc8a-54e244d8ef22 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:37.600868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-96f769b5-d5a6-4099-bc8a-54e244d8ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:37.609447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 645/1287] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:37.633251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7b3b1-9005-4930-8213-8d6249b257a0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:37.646738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7b3b1-9005-4930-8213-8d6249b257a0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:37.651242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:37.652263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:37.652544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:37.652820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:37.653510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:37.655232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:37.666753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 18:04:37.668355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 643/1288] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:04:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:37.674756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f769b5-d5a6-4099-bc8a-54e244d8ef22 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:37.684683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f769b5-d5a6-4099-bc8a-54e244d8ef22 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:37.689428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b823a1-82af-486c-82a2-95295f6e93d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:37.694534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b823a1-82af-486c-82a2-95295f6e93d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:37.694534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b823a1-82af-486c-82a2-95295f6e93d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:37.694534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b823a1-82af-486c-82a2-95295f6e93d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:37.694534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b823a1-82af-486c-82a2-95295f6e93d5 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:37.694534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b823a1-82af-486c-82a2-95295f6e93d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:37.694534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b823a1-82af-486c-82a2-95295f6e93d5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:37.699393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 646/1289] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Feb 16 18:04:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:37.705315 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:37.715796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f6d3-fbb5-4f41-a87b-9769076a2bb6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:37.720810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be707f7-f785-4519-8167-070860639f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:37.721500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be707f7-f785-4519-8167-070860639f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:37.721786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be707f7-f785-4519-8167-070860639f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:37.722060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be707f7-f785-4519-8167-070860639f04 admin admin] PATH_INFO: `/v3/services` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:37.722766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be707f7-f785-4519-8167-070860639f04 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:37.723069 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be707f7-f785-4519-8167-070860639f04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:37.724643 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be707f7-f785-4519-8167-070860639f04 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:37.729508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 644/1290] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Feb 16 18:04:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:40.055060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea462c94-1ea0-47d1-bd1d-945514a2f955 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:40.055603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea462c94-1ea0-47d1-bd1d-945514a2f955 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:40.055603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea462c94-1ea0-47d1-bd1d-945514a2f955 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:40.057695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 647/1291] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:40.063237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620970e5-4ae1-4718-87c6-a1561eb53c81 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:40.063703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620970e5-4ae1-4718-87c6-a1561eb53c81 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:40.063790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620970e5-4ae1-4718-87c6-a1561eb53c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:40.082814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-620970e5-4ae1-4718-87c6-a1561eb53c81 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:40.084157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-620970e5-4ae1-4718-87c6-a1561eb53c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:40.093095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 645/1292] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:40.116199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea462c94-1ea0-47d1-bd1d-945514a2f955 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:40.128445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea462c94-1ea0-47d1-bd1d-945514a2f955 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:40.132767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbfdf0-812d-40f7-9ac4-f6a9da8b742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:40.133452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbfdf0-812d-40f7-9ac4-f6a9da8b742d admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:40.133731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbfdf0-812d-40f7-9ac4-f6a9da8b742d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:40.134005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbfdf0-812d-40f7-9ac4-f6a9da8b742d admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:40.134719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbfdf0-812d-40f7-9ac4-f6a9da8b742d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:40.136968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbfdf0-812d-40f7-9ac4-f6a9da8b742d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:40.264210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 648/1293] 10.222.0.87 () {60 vars in 1162 bytes} [Wed Feb 16 18:04:40 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:04:42.601632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf88468-02a1-4136-9085-1aaf49338c74 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:42.602155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf88468-02a1-4136-9085-1aaf49338c74 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:42.602155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf88468-02a1-4136-9085-1aaf49338c74 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:42.604682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 646/1294] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:42.609767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f214e24-e77b-43c2-913d-23eb772ce4df None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:42.610211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f214e24-e77b-43c2-913d-23eb772ce4df None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:42.610322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f214e24-e77b-43c2-913d-23eb772ce4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:42.628593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8f214e24-e77b-43c2-913d-23eb772ce4df None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:42.629818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8f214e24-e77b-43c2-913d-23eb772ce4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:42.647201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 649/1295] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:42 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:42.671139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf88468-02a1-4136-9085-1aaf49338c74 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:42.684442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf88468-02a1-4136-9085-1aaf49338c74 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:42.690060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:42.690868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:42.691154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:42.691433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:42.693190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:42.693774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:42.706029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 18:04:42.707242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 647/1296] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:04:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:42.713918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f214e24-e77b-43c2-913d-23eb772ce4df None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:42.723021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f214e24-e77b-43c2-913d-23eb772ce4df None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:42.727690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:42.728341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:42.728659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:42.729797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:42.730825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:42.731163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:42.733404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:42.738890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 650/1297] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Feb 16 18:04:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:42.744957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:42.755560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32741923-ff73-4f6c-bec9-332175703da9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:42.760467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e6a19-7561-4314-81b9-c1a817217031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:42.762059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e6a19-7561-4314-81b9-c1a817217031 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:42.762059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e6a19-7561-4314-81b9-c1a817217031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:42.762239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e6a19-7561-4314-81b9-c1a817217031 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:42.762989 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e6a19-7561-4314-81b9-c1a817217031 admin admin] RBAC: Adding query filter params (interface=public, service_id=2a33a50b9367404a8585be6c59b84df9, region_id=RegionOne) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:42.763298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e6a19-7561-4314-81b9-c1a817217031 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:42.764892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e6a19-7561-4314-81b9-c1a817217031 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:42.770459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 648/1298] 10.222.0.87 () {56 vars in 1272 bytes} [Wed Feb 16 18:04:42 2022] GET /identity/v3/endpoints?service_id=2a33a50b9367404a8585be6c59b84df9&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:42.776662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:42.786914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3f270-8b3e-4b5c-94c3-747450309169 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:42.792210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954943-a0d3-4a25-a911-4957bef26a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:42.802655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954943-a0d3-4a25-a911-4957bef26a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:42.802655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954943-a0d3-4a25-a911-4957bef26a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:42.802655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954943-a0d3-4a25-a911-4957bef26a30 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:42.802655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954943-a0d3-4a25-a911-4957bef26a30 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:42.802655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954943-a0d3-4a25-a911-4957bef26a30 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:42.804203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 651/1299] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:04:42 2022] GET /identity/v3/services => generated 2191 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:04:45.173559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df688d-0fa4-42c3-8a39-62bd8b5d062f None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:45.174101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df688d-0fa4-42c3-8a39-62bd8b5d062f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:45.174101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df688d-0fa4-42c3-8a39-62bd8b5d062f None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:45.176042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 649/1300] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:04:45.181414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a503e2-9805-4e12-a8ee-5a2a2867ad95 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:45.181964 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a503e2-9805-4e12-a8ee-5a2a2867ad95 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:45.182354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a503e2-9805-4e12-a8ee-5a2a2867ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:45.200627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-85a503e2-9805-4e12-a8ee-5a2a2867ad95 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:04:45.201897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-85a503e2-9805-4e12-a8ee-5a2a2867ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:04:45.209684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 652/1301] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:04:45 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:04:45.234459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df688d-0fa4-42c3-8a39-62bd8b5d062f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:45.247312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df688d-0fa4-42c3-8a39-62bd8b5d062f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:45.251778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:45.252569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:45.252852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:45.253155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:45.253894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:45.255469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:45.267408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING keystone.server.flask.application [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 18:04:45.272649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 650/1302] 10.222.0.87 () {56 vars in 1138 bytes} [Wed Feb 16 18:04:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 18:04:45.274689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a503e2-9805-4e12-a8ee-5a2a2867ad95 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:45.284361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a503e2-9805-4e12-a8ee-5a2a2867ad95 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:45.289284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d295668-1efa-4aa1-bff4-01e987acbd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:45.289948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d295668-1efa-4aa1-bff4-01e987acbd41 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:45.290231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d295668-1efa-4aa1-bff4-01e987acbd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:45.290507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d295668-1efa-4aa1-bff4-01e987acbd41 admin admin] PATH_INFO: `/v3/services` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:45.291216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d295668-1efa-4aa1-bff4-01e987acbd41 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:04:45.292139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d295668-1efa-4aa1-bff4-01e987acbd41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:45.293938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d295668-1efa-4aa1-bff4-01e987acbd41 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:45.300535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 653/1303] 10.222.0.87 () {56 vars in 1137 bytes} [Wed Feb 16 18:04:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:04:45.306384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:04:45.318274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766ecea-c63d-49dd-ac67-0ac03fd603b3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:04:45.324138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2698e43-f41f-414d-96fe-1cb272e4dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:04:45.324803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2698e43-f41f-414d-96fe-1cb272e4dcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:04:45.330048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2698e43-f41f-414d-96fe-1cb272e4dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:04:45.330048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2698e43-f41f-414d-96fe-1cb272e4dcb9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:04:45.330048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2698e43-f41f-414d-96fe-1cb272e4dcb9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:04:45.330048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2698e43-f41f-414d-96fe-1cb272e4dcb9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:04:45.411682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 651/1304] 10.222.0.87 () {60 vars in 1165 bytes} [Wed Feb 16 18:04:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:11:34.978668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31af3c-5850-4ae3-9787-379f2df92733 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:34.979865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31af3c-5850-4ae3-9787-379f2df92733 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:34.980558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31af3c-5850-4ae3-9787-379f2df92733 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:34.982948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 654/1305] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:34.988982 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8826-1c6c-47f0-9469-1d3f79d10614 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:34.990118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8826-1c6c-47f0-9469-1d3f79d10614 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:34.990566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8826-1c6c-47f0-9469-1d3f79d10614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:35.094538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-cedb8826-1c6c-47f0-9469-1d3f79d10614 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:35.096317 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cedb8826-1c6c-47f0-9469-1d3f79d10614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:35.321350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 652/1306] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:35.331398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31af3c-5850-4ae3-9787-379f2df92733 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:35.333384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fd31af3c-5850-4ae3-9787-379f2df92733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:35.508442 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31af3c-5850-4ae3-9787-379f2df92733 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:35.610196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f6fae-8091-419e-813a-e301447bb114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:35.610822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6fae-8091-419e-813a-e301447bb114 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:35.611109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6fae-8091-419e-813a-e301447bb114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:35.611411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6fae-8091-419e-813a-e301447bb114 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:35.612137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f6fae-8091-419e-813a-e301447bb114 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:35.614080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f6fae-8091-419e-813a-e301447bb114 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:35.633178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 655/1307] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:11:35 2022] GET /identity/v3/projects => generated 2553 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:11:38.098366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3930f-7359-4f7a-8724-3a1dace555ff None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:38.100166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3930f-7359-4f7a-8724-3a1dace555ff None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:38.100166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3930f-7359-4f7a-8724-3a1dace555ff None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:38.101210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 653/1308] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:38.106811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f730a-6a68-4924-98e0-5305bdf1b4af None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:38.107316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f730a-6a68-4924-98e0-5305bdf1b4af None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:38.107392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f730a-6a68-4924-98e0-5305bdf1b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:38.185063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-396f730a-6a68-4924-98e0-5305bdf1b4af None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:38.186498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-396f730a-6a68-4924-98e0-5305bdf1b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:38.314213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 656/1309] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:11:38.369502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf608f-0c8c-4eb2-912b-3902a5c2be36 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:38.369830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf608f-0c8c-4eb2-912b-3902a5c2be36 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:38.370018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf608f-0c8c-4eb2-912b-3902a5c2be36 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:38.372134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 654/1310] 10.222.0.87 () {54 vars in 964 bytes} [Wed Feb 16 18:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:38.378849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b2733-72ca-4a38-971c-94afee03fa36 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:38.379363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b2733-72ca-4a38-971c-94afee03fa36 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:38.380040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b2733-72ca-4a38-971c-94afee03fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:38.474634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-234b2733-72ca-4a38-971c-94afee03fa36 None None] MFA Rules not processed for user `9b842d30b55c48bf8f375bdcc829bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:38.477307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-234b2733-72ca-4a38-971c-94afee03fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:38.591670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 657/1311] 10.222.0.87 () {58 vars in 1061 bytes} [Wed Feb 16 18:11:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:11:38.601287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf608f-0c8c-4eb2-912b-3902a5c2be36 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:38.603356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1fcf608f-0c8c-4eb2-912b-3902a5c2be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:38.722507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf608f-0c8c-4eb2-912b-3902a5c2be36 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:38.822494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d768e-3f2d-41d0-a243-f9efa8100f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:38.823334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d768e-3f2d-41d0-a243-f9efa8100f53 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:38.823626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d768e-3f2d-41d0-a243-f9efa8100f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:38.823901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d768e-3f2d-41d0-a243-f9efa8100f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:38.825640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-af5d768e-3f2d-41d0-a243-f9efa8100f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:38.957232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d768e-3f2d-41d0-a243-f9efa8100f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:38.959123 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d768e-3f2d-41d0-a243-f9efa8100f53 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:38.980575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 655/1312] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:11:41.619959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018232e-22e8-4ba2-88b7-b1147e7a6621 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:41.620564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018232e-22e8-4ba2-88b7-b1147e7a6621 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:41.620564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018232e-22e8-4ba2-88b7-b1147e7a6621 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:41.622365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 658/1313] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:41.627871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18af9-9c2a-4487-aacc-917814bacf91 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:41.628327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18af9-9c2a-4487-aacc-917814bacf91 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:41.628439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18af9-9c2a-4487-aacc-917814bacf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:41.699266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4ce18af9-9c2a-4487-aacc-917814bacf91 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:41.700495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4ce18af9-9c2a-4487-aacc-917814bacf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:41.795267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 656/1314] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:41.849775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e422-d057-456a-a084-cd874f6b01c4 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:41.850061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e422-d057-456a-a084-cd874f6b01c4 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:41.850334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e422-d057-456a-a084-cd874f6b01c4 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:41.852151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 659/1315] 10.222.0.87 () {54 vars in 964 bytes} [Wed Feb 16 18:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:41.859073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc0a5-fc9a-4d70-82b9-a56a3c6afef6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:41.859364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc0a5-fc9a-4d70-82b9-a56a3c6afef6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:41.859642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc0a5-fc9a-4d70-82b9-a56a3c6afef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:41.941171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4ddcc0a5-fc9a-4d70-82b9-a56a3c6afef6 None None] MFA Rules not processed for user `9b842d30b55c48bf8f375bdcc829bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:41.942386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4ddcc0a5-fc9a-4d70-82b9-a56a3c6afef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:42.018632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 657/1316] 10.222.0.87 () {58 vars in 1061 bytes} [Wed Feb 16 18:11:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:42.028738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e422-d057-456a-a084-cd874f6b01c4 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:42.030325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6c00e422-d057-456a-a084-cd874f6b01c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:42.139534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e422-d057-456a-a084-cd874f6b01c4 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:42.214795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060e38a-feba-4044-9023-bba5cc930b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:42.215472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e38a-feba-4044-9023-bba5cc930b60 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:42.215760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e38a-feba-4044-9023-bba5cc930b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:42.216039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e38a-feba-4044-9023-bba5cc930b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:42.217768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5060e38a-feba-4044-9023-bba5cc930b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:42.339128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060e38a-feba-4044-9023-bba5cc930b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:42.341105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060e38a-feba-4044-9023-bba5cc930b60 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:42.359939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 660/1317] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:11:45.452899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f519-8a94-451b-a580-8becb50ad1d0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:45.453469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f519-8a94-451b-a580-8becb50ad1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:45.453563 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f519-8a94-451b-a580-8becb50ad1d0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:45.455309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 658/1318] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:45.460787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8220-a997-4ece-bd43-7c16ea78afac None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:45.461232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8220-a997-4ece-bd43-7c16ea78afac None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:45.461386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8220-a997-4ece-bd43-7c16ea78afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:45.523581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ca7a8220-a997-4ece-bd43-7c16ea78afac None None] MFA Rules not processed for user `5abd0ea4fb81436881102a7e93ae2675`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:45.524794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ca7a8220-a997-4ece-bd43-7c16ea78afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:45.621687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 661/1319] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:45.662264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4f519-8a94-451b-a580-8becb50ad1d0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:45.663820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d9c4f519-8a94-451b-a580-8becb50ad1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:45.766589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4f519-8a94-451b-a580-8becb50ad1d0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:45.844239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271da581-6329-4d61-921b-6b02bcbeb882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:45.844918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271da581-6329-4d61-921b-6b02bcbeb882 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:45.845229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271da581-6329-4d61-921b-6b02bcbeb882 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:45.845512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271da581-6329-4d61-921b-6b02bcbeb882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:45.847168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-271da581-6329-4d61-921b-6b02bcbeb882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:45.953770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271da581-6329-4d61-921b-6b02bcbeb882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:45.955218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271da581-6329-4d61-921b-6b02bcbeb882 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:45.973857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 659/1320] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:11:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:11:49.074773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b688bf3-7e3f-4ff6-be6b-856b7b81e22b None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:49.075308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b688bf3-7e3f-4ff6-be6b-856b7b81e22b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:49.075400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b688bf3-7e3f-4ff6-be6b-856b7b81e22b None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:49.077145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 662/1321] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:49.082222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5953fe-694d-448f-a14f-1b42dea2425c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:49.082664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5953fe-694d-448f-a14f-1b42dea2425c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:49.082766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5953fe-694d-448f-a14f-1b42dea2425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:49.148140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8b5953fe-694d-448f-a14f-1b42dea2425c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:49.149416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8b5953fe-694d-448f-a14f-1b42dea2425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:49.249092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 660/1322] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:49.288827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b688bf3-7e3f-4ff6-be6b-856b7b81e22b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:49.290928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9b688bf3-7e3f-4ff6-be6b-856b7b81e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:49.394278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b688bf3-7e3f-4ff6-be6b-856b7b81e22b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:49.467476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10d4a5-6eb3-48e2-8b90-d20482283160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:49.468122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10d4a5-6eb3-48e2-8b90-d20482283160 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:49.468409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10d4a5-6eb3-48e2-8b90-d20482283160 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:49.468683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10d4a5-6eb3-48e2-8b90-d20482283160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:49.470342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0a10d4a5-6eb3-48e2-8b90-d20482283160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:49.579734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10d4a5-6eb3-48e2-8b90-d20482283160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:49.581238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10d4a5-6eb3-48e2-8b90-d20482283160 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:49.599631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 663/1323] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:11:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:11:53.067878 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319429f-6ccd-4b74-a170-bbaf97230a1b None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:53.068452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319429f-6ccd-4b74-a170-bbaf97230a1b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:53.068452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319429f-6ccd-4b74-a170-bbaf97230a1b None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:53.070274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 661/1324] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:53.077470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba230-1f66-4185-a4c5-4fcef65f5038 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:53.077982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba230-1f66-4185-a4c5-4fcef65f5038 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:53.078314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba230-1f66-4185-a4c5-4fcef65f5038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:53.167897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-590ba230-1f66-4185-a4c5-4fcef65f5038 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:53.169128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-590ba230-1f66-4185-a4c5-4fcef65f5038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:53.278508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 664/1325] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:53.316983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319429f-6ccd-4b74-a170-bbaf97230a1b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:53.318607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9319429f-6ccd-4b74-a170-bbaf97230a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:53.427640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319429f-6ccd-4b74-a170-bbaf97230a1b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:53.502611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c1725-546d-4626-8f4c-5ffd78d3fcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:53.503276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1725-546d-4626-8f4c-5ffd78d3fcae service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:53.503554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1725-546d-4626-8f4c-5ffd78d3fcae service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:53.503825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c1725-546d-4626-8f4c-5ffd78d3fcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:53.505474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-746c1725-546d-4626-8f4c-5ffd78d3fcae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:53.618679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c1725-546d-4626-8f4c-5ffd78d3fcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:53.620008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c1725-546d-4626-8f4c-5ffd78d3fcae service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:53.639776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 662/1326] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:11:56.043770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d735f-deee-49fe-a1ee-762c39b3dc34 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:56.044353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d735f-deee-49fe-a1ee-762c39b3dc34 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:56.044353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d735f-deee-49fe-a1ee-762c39b3dc34 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:56.050970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 665/1327] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:11:56.053407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6b5c9-29e7-48b9-9c9a-1e3ac49a17ef None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:56.053849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6b5c9-29e7-48b9-9c9a-1e3ac49a17ef None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:56.054093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6b5c9-29e7-48b9-9c9a-1e3ac49a17ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:56.129226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-85a6b5c9-29e7-48b9-9c9a-1e3ac49a17ef None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:56.130374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-85a6b5c9-29e7-48b9-9c9a-1e3ac49a17ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:56.239075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 663/1328] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:56.276858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d735f-deee-49fe-a1ee-762c39b3dc34 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:56.278456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3c4d735f-deee-49fe-a1ee-762c39b3dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:56.380293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d735f-deee-49fe-a1ee-762c39b3dc34 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:56.451930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fca196-beeb-4e11-9f15-1c707f0082e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:56.452578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca196-beeb-4e11-9f15-1c707f0082e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:56.452864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca196-beeb-4e11-9f15-1c707f0082e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:56.453178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fca196-beeb-4e11-9f15-1c707f0082e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:56.454828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e6fca196-beeb-4e11-9f15-1c707f0082e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:56.561368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fca196-beeb-4e11-9f15-1c707f0082e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:56.563105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fca196-beeb-4e11-9f15-1c707f0082e1 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:56.581179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 666/1329] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:11:58.979921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d38cc-847b-42ac-aa89-3b5e716d46e9 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:58.980453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d38cc-847b-42ac-aa89-3b5e716d46e9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:58.980580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d38cc-847b-42ac-aa89-3b5e716d46e9 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:58.982343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 664/1330] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:11:58.987524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031d1ad-bac6-4a0c-906c-249e8d121e75 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:58.987929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031d1ad-bac6-4a0c-906c-249e8d121e75 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:58.988076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031d1ad-bac6-4a0c-906c-249e8d121e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:59.057662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9031d1ad-bac6-4a0c-906c-249e8d121e75 None None] MFA Rules not processed for user `5abd0ea4fb81436881102a7e93ae2675`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:11:59.058874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9031d1ad-bac6-4a0c-906c-249e8d121e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:59.160524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 667/1331] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:11:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:11:59.201436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d38cc-847b-42ac-aa89-3b5e716d46e9 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:11:59.202986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d53d38cc-847b-42ac-aa89-3b5e716d46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:59.308105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d38cc-847b-42ac-aa89-3b5e716d46e9 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:11:59.381967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758c267-74b8-4e07-b488-20db6cb1c079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:11:59.382633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c267-74b8-4e07-b488-20db6cb1c079 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:11:59.382917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c267-74b8-4e07-b488-20db6cb1c079 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:11:59.383193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758c267-74b8-4e07-b488-20db6cb1c079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:11:59.385061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7758c267-74b8-4e07-b488-20db6cb1c079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:11:59.494013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c267-74b8-4e07-b488-20db6cb1c079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:11:59.495447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758c267-74b8-4e07-b488-20db6cb1c079 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:11:59.513855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 665/1332] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:11:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:02.599321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e13f-1a3d-463a-8b79-5dbd8351da09 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:02.599866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e13f-1a3d-463a-8b79-5dbd8351da09 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:02.599866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e13f-1a3d-463a-8b79-5dbd8351da09 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:02.601686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 668/1333] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:02.607713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6de02-604d-4ba2-979d-262cf5798186 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:02.608202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6de02-604d-4ba2-979d-262cf5798186 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:02.608305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6de02-604d-4ba2-979d-262cf5798186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:02.675400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2ca6de02-604d-4ba2-979d-262cf5798186 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:02.676631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2ca6de02-604d-4ba2-979d-262cf5798186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:02.797598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 666/1334] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:02.834644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e13f-1a3d-463a-8b79-5dbd8351da09 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:02.836216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d0e4e13f-1a3d-463a-8b79-5dbd8351da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:02.946934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e13f-1a3d-463a-8b79-5dbd8351da09 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:03.021700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db453fdf-0557-4b51-84fd-472024c2f937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:03.022361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db453fdf-0557-4b51-84fd-472024c2f937 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:03.022643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db453fdf-0557-4b51-84fd-472024c2f937 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:03.022920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db453fdf-0557-4b51-84fd-472024c2f937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:03.024798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-db453fdf-0557-4b51-84fd-472024c2f937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:03.135788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db453fdf-0557-4b51-84fd-472024c2f937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:03.137299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db453fdf-0557-4b51-84fd-472024c2f937 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:03.156850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 669/1335] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:05.700791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bfd6e-33b7-4c7b-9510-d0e115e0c519 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:05.701473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bfd6e-33b7-4c7b-9510-d0e115e0c519 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:05.701473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bfd6e-33b7-4c7b-9510-d0e115e0c519 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:05.703214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 667/1336] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:05.708590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ae7b5-c264-4e5c-a3d4-9d6899e7eb7c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:05.709065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ae7b5-c264-4e5c-a3d4-9d6899e7eb7c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:05.709194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ae7b5-c264-4e5c-a3d4-9d6899e7eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:05.780948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-aa1ae7b5-c264-4e5c-a3d4-9d6899e7eb7c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:05.782091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-aa1ae7b5-c264-4e5c-a3d4-9d6899e7eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:05.890283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 670/1337] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:05.932278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bfd6e-33b7-4c7b-9510-d0e115e0c519 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:05.934474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-796bfd6e-33b7-4c7b-9510-d0e115e0c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:06.031946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bfd6e-33b7-4c7b-9510-d0e115e0c519 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:06.035621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfc5b4-a32e-4357-98c5-4f7f98d3d40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:06.036274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfc5b4-a32e-4357-98c5-4f7f98d3d40a service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:06.036555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfc5b4-a32e-4357-98c5-4f7f98d3d40a service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:06.036831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfc5b4-a32e-4357-98c5-4f7f98d3d40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:06.046846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfc5b4-a32e-4357-98c5-4f7f98d3d40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:06.048300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfc5b4-a32e-4357-98c5-4f7f98d3d40a service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:06.058725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 668/1338] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:09.135994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581c40-48de-41d2-8ea3-50a1e15d6816 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:09.136581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581c40-48de-41d2-8ea3-50a1e15d6816 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:09.136581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581c40-48de-41d2-8ea3-50a1e15d6816 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:09.138368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 671/1339] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:09.143912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988da1-f5f5-4952-bfa7-affa1d5f10c3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:09.144362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988da1-f5f5-4952-bfa7-affa1d5f10c3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:09.144478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988da1-f5f5-4952-bfa7-affa1d5f10c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:09.174299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-a3988da1-f5f5-4952-bfa7-affa1d5f10c3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:09.175925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a3988da1-f5f5-4952-bfa7-affa1d5f10c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:09.256538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 669/1340] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:09.294376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581c40-48de-41d2-8ea3-50a1e15d6816 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:09.304899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581c40-48de-41d2-8ea3-50a1e15d6816 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:09.309375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae32a1-f2a7-4009-bb20-1fa237b10ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:09.310022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae32a1-f2a7-4009-bb20-1fa237b10ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:09.310310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae32a1-f2a7-4009-bb20-1fa237b10ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:09.310590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae32a1-f2a7-4009-bb20-1fa237b10ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:09.320559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae32a1-f2a7-4009-bb20-1fa237b10ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:09.322786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae32a1-f2a7-4009-bb20-1fa237b10ce6 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:09.335379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 672/1341] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:14.146553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3ac5-7b08-4dab-9108-8fb7897eff0e None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:14.147102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3ac5-7b08-4dab-9108-8fb7897eff0e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:14.147102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3ac5-7b08-4dab-9108-8fb7897eff0e None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:14.148905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 670/1342] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:14.154887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166ff5-01a0-4d9f-aaef-24f72cdf3e9b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:14.155364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166ff5-01a0-4d9f-aaef-24f72cdf3e9b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:14.155469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166ff5-01a0-4d9f-aaef-24f72cdf3e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:14.174150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0c166ff5-01a0-4d9f-aaef-24f72cdf3e9b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:14.175364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0c166ff5-01a0-4d9f-aaef-24f72cdf3e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:14.183783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 673/1343] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:14.224263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3ac5-7b08-4dab-9108-8fb7897eff0e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:14.235729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3ac5-7b08-4dab-9108-8fb7897eff0e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:14.239642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa44226-7c42-4ece-b6db-4aeb924d7e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:14.240282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44226-7c42-4ece-b6db-4aeb924d7e67 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:14.240572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44226-7c42-4ece-b6db-4aeb924d7e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:14.240850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa44226-7c42-4ece-b6db-4aeb924d7e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:14.251224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa44226-7c42-4ece-b6db-4aeb924d7e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:14.252768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa44226-7c42-4ece-b6db-4aeb924d7e67 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:14.263038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 671/1344] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:17.660490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1cc7c-bf79-43f1-ade6-6db03301c787 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:17.661039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1cc7c-bf79-43f1-ade6-6db03301c787 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:17.661144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1cc7c-bf79-43f1-ade6-6db03301c787 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:17.662975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 674/1345] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:17.668555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab80d-d163-4486-bd36-d375d309bca3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:17.669011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab80d-d163-4486-bd36-d375d309bca3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:17.669141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ab80d-d163-4486-bd36-d375d309bca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:17.687205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-495ab80d-d163-4486-bd36-d375d309bca3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:17.688667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-495ab80d-d163-4486-bd36-d375d309bca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:17.697387 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 672/1346] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:17.736127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1cc7c-bf79-43f1-ade6-6db03301c787 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:17.748008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1cc7c-bf79-43f1-ade6-6db03301c787 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:17.751925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecf254-f35d-4306-b923-989ec7452c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:17.752595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf254-f35d-4306-b923-989ec7452c69 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:17.752872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf254-f35d-4306-b923-989ec7452c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:17.753160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf254-f35d-4306-b923-989ec7452c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:17.763208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecf254-f35d-4306-b923-989ec7452c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:17.764639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecf254-f35d-4306-b923-989ec7452c69 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:17.777328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 675/1347] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:22.617116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93924-f9e5-4412-bd0f-576c3344d82c None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:22.617631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93924-f9e5-4412-bd0f-576c3344d82c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:22.617631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93924-f9e5-4412-bd0f-576c3344d82c None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:22.619835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 673/1348] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:22.625059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23198cd-d06d-425b-b347-eafbac19c1ee None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:22.625525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23198cd-d06d-425b-b347-eafbac19c1ee None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:22.625650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23198cd-d06d-425b-b347-eafbac19c1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:22.644269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b23198cd-d06d-425b-b347-eafbac19c1ee None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:22.645520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b23198cd-d06d-425b-b347-eafbac19c1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:22.654188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 676/1349] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:22.692554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c93924-f9e5-4412-bd0f-576c3344d82c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:22.703325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c93924-f9e5-4412-bd0f-576c3344d82c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:22.707130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0743c09-8183-438c-907a-071086ea8cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:22.707776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0743c09-8183-438c-907a-071086ea8cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:22.708060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0743c09-8183-438c-907a-071086ea8cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:22.708336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0743c09-8183-438c-907a-071086ea8cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:22.717923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0743c09-8183-438c-907a-071086ea8cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:22.719344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0743c09-8183-438c-907a-071086ea8cf8 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:22.729392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 674/1350] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:12:28.241900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6249a-67be-4597-92a2-2fc68325d783 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:28.241900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6249a-67be-4597-92a2-2fc68325d783 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:28.241900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6249a-67be-4597-92a2-2fc68325d783 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:28.241900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 677/1351] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:28.249850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a49c8-9cf0-4d53-a02d-99a3777329b8 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:28.250402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a49c8-9cf0-4d53-a02d-99a3777329b8 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:28.250402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a49c8-9cf0-4d53-a02d-99a3777329b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:28.433616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0e7a49c8-9cf0-4d53-a02d-99a3777329b8 None None] MFA Rules not processed for user `6b08679e2a634bf08a279b6d8a9ffc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:28.435248 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0e7a49c8-9cf0-4d53-a02d-99a3777329b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:28.558438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 675/1352] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:12:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:33.759760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75842618-f4c9-42ce-b486-fb8bbce1f994 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:33.760769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75842618-f4c9-42ce-b486-fb8bbce1f994 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:33.761051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75842618-f4c9-42ce-b486-fb8bbce1f994 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:33.763223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 678/1353] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:12:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:33.769121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c614b-4ceb-41f3-9ca8-ed2dd635089f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:33.769641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c614b-4ceb-41f3-9ca8-ed2dd635089f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:33.770074 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c614b-4ceb-41f3-9ca8-ed2dd635089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:33.789769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8d9c614b-4ceb-41f3-9ca8-ed2dd635089f None None] MFA Rules not processed for user `6b08679e2a634bf08a279b6d8a9ffc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:33.791497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8d9c614b-4ceb-41f3-9ca8-ed2dd635089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:33.800657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 676/1354] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:12:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:35.578922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdc7d1-a660-4007-b464-f5317563e79e None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:35.579439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdc7d1-a660-4007-b464-f5317563e79e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:35.579516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fdc7d1-a660-4007-b464-f5317563e79e None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:35.581325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 679/1355] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:35.588062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db929-87a4-4a5c-9b20-293429d95287 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:35.588573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db929-87a4-4a5c-9b20-293429d95287 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:35.594332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db929-87a4-4a5c-9b20-293429d95287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:35.608885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-524db929-87a4-4a5c-9b20-293429d95287 None None] MFA Rules not processed for user `6b08679e2a634bf08a279b6d8a9ffc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:35.610152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-524db929-87a4-4a5c-9b20-293429d95287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:35.619252 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 677/1356] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:12:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:39.552168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578978d-a441-4846-88c9-8271bbd01d81 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:39.552678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578978d-a441-4846-88c9-8271bbd01d81 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:39.552973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578978d-a441-4846-88c9-8271bbd01d81 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:39.555406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 680/1357] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:39.560960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7e34f-3a68-4880-a338-60181be48149 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:39.561502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7e34f-3a68-4880-a338-60181be48149 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:39.561583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7e34f-3a68-4880-a338-60181be48149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:39.582045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7dc7e34f-3a68-4880-a338-60181be48149 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:39.583312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7dc7e34f-3a68-4880-a338-60181be48149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:39.592834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 678/1358] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:39.642192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8700-eee1-48c5-b911-0dc54374b04b None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:39.642614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8700-eee1-48c5-b911-0dc54374b04b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:39.643187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca8700-eee1-48c5-b911-0dc54374b04b None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:39.645109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 681/1359] 10.222.0.87 () {54 vars in 961 bytes} [Wed Feb 16 18:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:39.652240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbee9-6bb9-4f80-99b3-f4e027f38e54 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:39.652537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbee9-6bb9-4f80-99b3-f4e027f38e54 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:39.652820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bbee9-6bb9-4f80-99b3-f4e027f38e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:39.705516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ed9bbee9-6bb9-4f80-99b3-f4e027f38e54 None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:39.706733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ed9bbee9-6bb9-4f80-99b3-f4e027f38e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:39.790398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 679/1360] 10.222.0.87 () {58 vars in 1058 bytes} [Wed Feb 16 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:12:39.798258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8700-eee1-48c5-b911-0dc54374b04b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:39.813467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca8700-eee1-48c5-b911-0dc54374b04b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:39.819011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092412b-c5b3-4f5b-905e-fe191ea647a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:39.819658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092412b-c5b3-4f5b-905e-fe191ea647a3 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:39.819919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092412b-c5b3-4f5b-905e-fe191ea647a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:39.820381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092412b-c5b3-4f5b-905e-fe191ea647a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:39.829692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092412b-c5b3-4f5b-905e-fe191ea647a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:39.831547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092412b-c5b3-4f5b-905e-fe191ea647a3 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:39.841730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 682/1361] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:42.480488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d851b-e095-44b3-9a8e-38dec531b522 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:42.481289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d851b-e095-44b3-9a8e-38dec531b522 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:42.481289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d851b-e095-44b3-9a8e-38dec531b522 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:42.482957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 680/1362] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:42.488379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f2a83-d9e8-4eaa-acbd-0bef7208790e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:42.488881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f2a83-d9e8-4eaa-acbd-0bef7208790e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:42.488963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f2a83-d9e8-4eaa-acbd-0bef7208790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:42.509333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-5b4f2a83-d9e8-4eaa-acbd-0bef7208790e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:42.510952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5b4f2a83-d9e8-4eaa-acbd-0bef7208790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:42.519314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 683/1363] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:42.565984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d851b-e095-44b3-9a8e-38dec531b522 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:42.581601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d851b-e095-44b3-9a8e-38dec531b522 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:42.589280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80f827-79f7-409d-937f-48fe4a301628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:42.590042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f827-79f7-409d-937f-48fe4a301628 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:42.590404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f827-79f7-409d-937f-48fe4a301628 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:42.590911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80f827-79f7-409d-937f-48fe4a301628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:42.599792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80f827-79f7-409d-937f-48fe4a301628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:42.601535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80f827-79f7-409d-937f-48fe4a301628 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:42.612176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 681/1364] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:45.777072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c334-aad1-46a3-846a-bad74e2ce7e3 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:45.777591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c334-aad1-46a3-846a-bad74e2ce7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:45.777591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c334-aad1-46a3-846a-bad74e2ce7e3 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:45.779335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 684/1365] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:45.784939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116f1ee-5abc-4311-9dda-e7add8147c4e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:45.785425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116f1ee-5abc-4311-9dda-e7add8147c4e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:45.785608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116f1ee-5abc-4311-9dda-e7add8147c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:45.806134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7116f1ee-5abc-4311-9dda-e7add8147c4e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:45.807611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7116f1ee-5abc-4311-9dda-e7add8147c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:45.816496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 682/1366] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:45.864199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82c69-6f90-45cd-bb08-78fe6294cfd0 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:45.864484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82c69-6f90-45cd-bb08-78fe6294cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:45.864761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c82c69-6f90-45cd-bb08-78fe6294cfd0 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:45.866752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 685/1367] 10.222.0.87 () {54 vars in 961 bytes} [Wed Feb 16 18:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:45.873595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6f772-ab61-4223-b963-3bcc22305fad None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:45.874009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6f772-ab61-4223-b963-3bcc22305fad None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:45.874527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6f772-ab61-4223-b963-3bcc22305fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:45.895465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-08c6f772-ab61-4223-b963-3bcc22305fad None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:45.896770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-08c6f772-ab61-4223-b963-3bcc22305fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:45.906726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 683/1368] 10.222.0.87 () {58 vars in 1058 bytes} [Wed Feb 16 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:45.915914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c82c69-6f90-45cd-bb08-78fe6294cfd0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:45.933703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c82c69-6f90-45cd-bb08-78fe6294cfd0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:45.941694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72056b39-e0f1-46b6-9e4c-041bca608b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:45.942554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72056b39-e0f1-46b6-9e4c-041bca608b30 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:45.942984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72056b39-e0f1-46b6-9e4c-041bca608b30 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:45.943268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72056b39-e0f1-46b6-9e4c-041bca608b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:45.954170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72056b39-e0f1-46b6-9e4c-041bca608b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:45.955913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72056b39-e0f1-46b6-9e4c-041bca608b30 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:45.969729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 686/1369] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:48.185686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85bc33-9a34-442a-a1d8-e416c0a5f8c1 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.186258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85bc33-9a34-442a-a1d8-e416c0a5f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.186258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85bc33-9a34-442a-a1d8-e416c0a5f8c1 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.188059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 684/1370] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:12:48.199053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38e5e-83c0-49dd-ad7f-381d981373fe None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.200114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38e5e-83c0-49dd-ad7f-381d981373fe None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.200410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38e5e-83c0-49dd-ad7f-381d981373fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.224036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8af38e5e-83c0-49dd-ad7f-381d981373fe None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:48.225295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8af38e5e-83c0-49dd-ad7f-381d981373fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:48.234506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 687/1371] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:48.501193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dfa1a-2eae-45e6-ab0f-938530b944d2 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.501420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dfa1a-2eae-45e6-ab0f-938530b944d2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.501885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dfa1a-2eae-45e6-ab0f-938530b944d2 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.503680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 685/1372] 10.222.0.87 () {54 vars in 963 bytes} [Wed Feb 16 18:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:48.509758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573063-df15-4aa1-94ee-0db2f86199ea None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.510260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573063-df15-4aa1-94ee-0db2f86199ea None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.510549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573063-df15-4aa1-94ee-0db2f86199ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.565910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a6573063-df15-4aa1-94ee-0db2f86199ea None None] MFA Rules not processed for user `829b4ad50f8441248c0b6d5259b89fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:48.566169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd780b-aa81-4ea0-9d3b-c0f36f703bff None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.566368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd780b-aa81-4ea0-9d3b-c0f36f703bff None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.566815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd780b-aa81-4ea0-9d3b-c0f36f703bff None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.567120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a6573063-df15-4aa1-94ee-0db2f86199ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:48.576462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 686/1373] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:48.578185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74448af-0183-4df5-afb7-3261694fc621 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.578476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74448af-0183-4df5-afb7-3261694fc621 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.578753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74448af-0183-4df5-afb7-3261694fc621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.598380 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d74448af-0183-4df5-afb7-3261694fc621 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:48.599880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d74448af-0183-4df5-afb7-3261694fc621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:48.609218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 687/1374] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:48.656889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74448af-0183-4df5-afb7-3261694fc621 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:48.666054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 688/1375] 10.222.0.87 () {58 vars in 1060 bytes} [Wed Feb 16 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:48.670039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74448af-0183-4df5-afb7-3261694fc621 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:48.675583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6dd3c-1ccd-4f93-8a3e-ef0a3d3797b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:48.676242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dd3c-1ccd-4f93-8a3e-ef0a3d3797b3 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.676525 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dd3c-1ccd-4f93-8a3e-ef0a3d3797b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.676801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dd3c-1ccd-4f93-8a3e-ef0a3d3797b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.681650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6573063-df15-4aa1-94ee-0db2f86199ea None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:48.686137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6dd3c-1ccd-4f93-8a3e-ef0a3d3797b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:48.687716 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6dd3c-1ccd-4f93-8a3e-ef0a3d3797b3 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:48.693109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6573063-df15-4aa1-94ee-0db2f86199ea None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:48.698515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a0495-3a03-4f8c-94b1-585f7a01876f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:48.699213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0495-3a03-4f8c-94b1-585f7a01876f service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:48.699464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0495-3a03-4f8c-94b1-585f7a01876f service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:48.699740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a0495-3a03-4f8c-94b1-585f7a01876f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:48.700128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 688/1376] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:12:48.710333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a0495-3a03-4f8c-94b1-585f7a01876f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:48.711976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a0495-3a03-4f8c-94b1-585f7a01876f service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:48.723590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 689/1377] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:51.309890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0feb9b-5a4b-4c9a-9145-49ba147fad89 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:51.310739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0feb9b-5a4b-4c9a-9145-49ba147fad89 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:51.310899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0feb9b-5a4b-4c9a-9145-49ba147fad89 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:51.312833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 689/1378] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:51.318896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180c5f-3af7-4af5-aac3-6ab4f4db0282 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:51.319396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180c5f-3af7-4af5-aac3-6ab4f4db0282 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:51.319504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0180c5f-3af7-4af5-aac3-6ab4f4db0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:51.339354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c0180c5f-3af7-4af5-aac3-6ab4f4db0282 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:51.340618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c0180c5f-3af7-4af5-aac3-6ab4f4db0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:51.349314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 690/1379] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:51.394924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0feb9b-5a4b-4c9a-9145-49ba147fad89 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:51.410767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0feb9b-5a4b-4c9a-9145-49ba147fad89 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:51.416783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb37c0-4c17-49ce-8c82-aebc20a57b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:51.417487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb37c0-4c17-49ce-8c82-aebc20a57b44 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:51.418452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb37c0-4c17-49ce-8c82-aebc20a57b44 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:51.418452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb37c0-4c17-49ce-8c82-aebc20a57b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:51.428107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb37c0-4c17-49ce-8c82-aebc20a57b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:51.430065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb37c0-4c17-49ce-8c82-aebc20a57b44 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:51.441110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 690/1380] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:54.044840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4863a-7f5b-4265-a3a3-e7ac5b601845 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:54.045430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4863a-7f5b-4265-a3a3-e7ac5b601845 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:54.045430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4863a-7f5b-4265-a3a3-e7ac5b601845 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:54.047242 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 691/1381] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:12:54.053125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04b90f-bdca-4321-9b04-9e9f3cf5fc88 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:54.054056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04b90f-bdca-4321-9b04-9e9f3cf5fc88 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:54.054347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04b90f-bdca-4321-9b04-9e9f3cf5fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:54.075743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2c04b90f-bdca-4321-9b04-9e9f3cf5fc88 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:54.077042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2c04b90f-bdca-4321-9b04-9e9f3cf5fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:54.086622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 691/1382] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:54.140309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4863a-7f5b-4265-a3a3-e7ac5b601845 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:54.156366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4863a-7f5b-4265-a3a3-e7ac5b601845 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:54.162132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c3153-cce9-4c9c-9ec4-132e0d1e5087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:54.162920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3153-cce9-4c9c-9ec4-132e0d1e5087 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:54.163313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3153-cce9-4c9c-9ec4-132e0d1e5087 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:54.163697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3153-cce9-4c9c-9ec4-132e0d1e5087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:54.175349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c3153-cce9-4c9c-9ec4-132e0d1e5087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:54.177136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c3153-cce9-4c9c-9ec4-132e0d1e5087 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:54.188573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 692/1383] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:12:56.844324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2f49e-12ef-45da-a330-7eecf2827c02 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:56.845013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2f49e-12ef-45da-a330-7eecf2827c02 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:56.845013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2f49e-12ef-45da-a330-7eecf2827c02 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:56.846686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 692/1384] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:56.854460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c209e-6aa6-4323-8451-73ec1f93eee4 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:56.854957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c209e-6aa6-4323-8451-73ec1f93eee4 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:56.855106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c209e-6aa6-4323-8451-73ec1f93eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:56.878307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e85c209e-6aa6-4323-8451-73ec1f93eee4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:56.879763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e85c209e-6aa6-4323-8451-73ec1f93eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:56.893700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 693/1385] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:12:56.946289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2f49e-12ef-45da-a330-7eecf2827c02 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:56.963220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2f49e-12ef-45da-a330-7eecf2827c02 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:56.969176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14645780-f612-44a9-a7d2-81777c12e173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:56.969882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645780-f612-44a9-a7d2-81777c12e173 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:56.970168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645780-f612-44a9-a7d2-81777c12e173 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:56.970463 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14645780-f612-44a9-a7d2-81777c12e173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:56.981798 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14645780-f612-44a9-a7d2-81777c12e173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:56.985444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14645780-f612-44a9-a7d2-81777c12e173 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:57.004709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 693/1386] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:12:59.462919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ac4fd-74b6-4eb1-9523-c84b863840f2 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:59.463505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ac4fd-74b6-4eb1-9523-c84b863840f2 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:59.463505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ac4fd-74b6-4eb1-9523-c84b863840f2 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:59.465198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 694/1387] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:12:59.471194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bb188-6d3c-4bae-9c00-05f553bb65e3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:59.471835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bb188-6d3c-4bae-9c00-05f553bb65e3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:59.471835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bb188-6d3c-4bae-9c00-05f553bb65e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:59.493132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-991bb188-6d3c-4bae-9c00-05f553bb65e3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:12:59.495115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-991bb188-6d3c-4bae-9c00-05f553bb65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:12:59.506595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 694/1388] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:12:59.554824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ac4fd-74b6-4eb1-9523-c84b863840f2 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:12:59.572580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ac4fd-74b6-4eb1-9523-c84b863840f2 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:12:59.578260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c879bdc-dd44-44c1-af89-80543f091d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:12:59.578911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c879bdc-dd44-44c1-af89-80543f091d1e service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:12:59.579197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c879bdc-dd44-44c1-af89-80543f091d1e service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:12:59.579475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c879bdc-dd44-44c1-af89-80543f091d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:12:59.589614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c879bdc-dd44-44c1-af89-80543f091d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:12:59.591646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c879bdc-dd44-44c1-af89-80543f091d1e service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:12:59.603357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 695/1389] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:02.441550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae77e08-f45e-4830-ad1c-ea29020870a8 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:02.442068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae77e08-f45e-4830-ad1c-ea29020870a8 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:02.442068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae77e08-f45e-4830-ad1c-ea29020870a8 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:02.443886 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 695/1390] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:02.450217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710fe8e-603c-4772-886d-8c78b7a74b6f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:02.450697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710fe8e-603c-4772-886d-8c78b7a74b6f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:02.450820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710fe8e-603c-4772-886d-8c78b7a74b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:02.469318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f710fe8e-603c-4772-886d-8c78b7a74b6f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:02.470504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f710fe8e-603c-4772-886d-8c78b7a74b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:02.479340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 696/1391] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:02.524657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae77e08-f45e-4830-ad1c-ea29020870a8 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:02.542941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae77e08-f45e-4830-ad1c-ea29020870a8 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:02.548747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3caa46-a960-4e5c-927e-b6cca7ba7308 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:02.549486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3caa46-a960-4e5c-927e-b6cca7ba7308 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:02.551161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3caa46-a960-4e5c-927e-b6cca7ba7308 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:02.551161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3caa46-a960-4e5c-927e-b6cca7ba7308 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:02.559039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3caa46-a960-4e5c-927e-b6cca7ba7308 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:02.560617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3caa46-a960-4e5c-927e-b6cca7ba7308 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:02.571429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 696/1392] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:04.705746 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07500be-0e91-4330-bc07-3f5ef63badb8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:04.706449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07500be-0e91-4330-bc07-3f5ef63badb8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:04.706449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07500be-0e91-4330-bc07-3f5ef63badb8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:04.709366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 697/1393] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:13:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:04.715237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0a4e-b31e-48b5-9e43-4933177b125e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:04.715761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0a4e-b31e-48b5-9e43-4933177b125e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:04.715862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0a4e-b31e-48b5-9e43-4933177b125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:04.736496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0d3c0a4e-b31e-48b5-9e43-4933177b125e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:04.737763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0d3c0a4e-b31e-48b5-9e43-4933177b125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:04.747051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 697/1394] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:13:04.809455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c07a2-6bb3-439f-8aad-9e68d5b4cf5d None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:04.809745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c07a2-6bb3-439f-8aad-9e68d5b4cf5d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:04.810022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c07a2-6bb3-439f-8aad-9e68d5b4cf5d None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:04.811920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 698/1395] 10.222.0.87 () {54 vars in 962 bytes} [Wed Feb 16 18:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:04.818549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e574bf-0191-4843-a0ab-3512d93e0e8b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:04.818870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e574bf-0191-4843-a0ab-3512d93e0e8b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:04.819182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e574bf-0191-4843-a0ab-3512d93e0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:04.882266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-a0e574bf-0191-4843-a0ab-3512d93e0e8b None None] MFA Rules not processed for user `715e34300eef47d9aa2839cb3c5c5fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:04.884280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a0e574bf-0191-4843-a0ab-3512d93e0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:04.946999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 698/1396] 10.222.0.87 () {58 vars in 1059 bytes} [Wed Feb 16 18:13:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:04.955013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c07a2-6bb3-439f-8aad-9e68d5b4cf5d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:04.966688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c07a2-6bb3-439f-8aad-9e68d5b4cf5d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:04.970231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a9a02-8864-4ccf-a3d7-888c5e26a1e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:04.970860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9a02-8864-4ccf-a3d7-888c5e26a1e1 service glance] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:04.971134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9a02-8864-4ccf-a3d7-888c5e26a1e1 service glance] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:04.971405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a9a02-8864-4ccf-a3d7-888c5e26a1e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:04.981517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a9a02-8864-4ccf-a3d7-888c5e26a1e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:04.982961 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a9a02-8864-4ccf-a3d7-888c5e26a1e1 service glance] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:04.993504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 699/1397] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:05.159245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72063999-f90f-40d1-ac6d-6b465390487a None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:05.159557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72063999-f90f-40d1-ac6d-6b465390487a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:05.159837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72063999-f90f-40d1-ac6d-6b465390487a None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:05.161736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 699/1398] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:05.167718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c88f-5118-4fec-8087-a7a6df17af24 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:05.168003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c88f-5118-4fec-8087-a7a6df17af24 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:05.168283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952c88f-5118-4fec-8087-a7a6df17af24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:05.186713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a952c88f-5118-4fec-8087-a7a6df17af24 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:05.187902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a952c88f-5118-4fec-8087-a7a6df17af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:05.197601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 700/1399] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:13:05.246894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72063999-f90f-40d1-ac6d-6b465390487a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:05.262453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72063999-f90f-40d1-ac6d-6b465390487a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:05.268065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0af55-ee58-4324-80cd-854cd2e4dff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:05.268669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0af55-ee58-4324-80cd-854cd2e4dff5 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:05.268957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0af55-ee58-4324-80cd-854cd2e4dff5 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:05.269265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0af55-ee58-4324-80cd-854cd2e4dff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:05.279079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0af55-ee58-4324-80cd-854cd2e4dff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:05.280669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0af55-ee58-4324-80cd-854cd2e4dff5 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:05.293935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 700/1400] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:05.675049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211b0a-bca5-40d9-bd28-c8cdf455a48c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:05.675049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211b0a-bca5-40d9-bd28-c8cdf455a48c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:05.675049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211b0a-bca5-40d9-bd28-c8cdf455a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:05.735515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c1211b0a-bca5-40d9-bd28-c8cdf455a48c None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:05.736774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c1211b0a-bca5-40d9-bd28-c8cdf455a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:05.805860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 701/1401] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:05.851051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ea0c-a4e3-40e6-a7d8-fb8d2cc8f946 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:05.851687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ea0c-a4e3-40e6-a7d8-fb8d2cc8f946 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:05.851687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ea0c-a4e3-40e6-a7d8-fb8d2cc8f946 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:05.853431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 701/1402] 10.222.0.87 () {54 vars in 942 bytes} [Wed Feb 16 18:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:13:05.860151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c603e1-8cfa-415e-9294-3267068821da None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:05.860466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c603e1-8cfa-415e-9294-3267068821da None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:05.860792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c603e1-8cfa-415e-9294-3267068821da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:05.925833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-15c603e1-8cfa-415e-9294-3267068821da None None] MFA Rules not processed for user `9450573df8c6430a8271e86f15954d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:05.927086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-15c603e1-8cfa-415e-9294-3267068821da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:06.007701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 702/1403] 10.222.0.87 () {58 vars in 1039 bytes} [Wed Feb 16 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:13:06.018445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ea0c-a4e3-40e6-a7d8-fb8d2cc8f946 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:06.033553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ea0c-a4e3-40e6-a7d8-fb8d2cc8f946 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:06.038565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4e650-92c3-4c93-8442-edf97af8f23e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:06.042625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e650-92c3-4c93-8442-edf97af8f23e service swift] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:06.042625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e650-92c3-4c93-8442-edf97af8f23e service swift] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:06.042625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e650-92c3-4c93-8442-edf97af8f23e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:06.049987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4e650-92c3-4c93-8442-edf97af8f23e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:06.051556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4e650-92c3-4c93-8442-edf97af8f23e service swift] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:06.060495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 702/1404] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:13:07.834381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeee192-ca7f-4aa7-bdf6-e2744d8b5598 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:07.835450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeee192-ca7f-4aa7-bdf6-e2744d8b5598 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:07.835816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeee192-ca7f-4aa7-bdf6-e2744d8b5598 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:07.839133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 703/1405] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:13:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:07.844788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d0b0-8fea-4992-9b81-358c8750a91d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:07.847312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d0b0-8fea-4992-9b81-358c8750a91d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:07.847312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881d0b0-8fea-4992-9b81-358c8750a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:07.871720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-1881d0b0-8fea-4992-9b81-358c8750a91d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:07.872924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1881d0b0-8fea-4992-9b81-358c8750a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:07.889016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 703/1406] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:07.939850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeee192-ca7f-4aa7-bdf6-e2744d8b5598 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:07.959025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeee192-ca7f-4aa7-bdf6-e2744d8b5598 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:07.973515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea8be9-271d-40f6-b207-abfaeb723caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:07.974271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8be9-271d-40f6-b207-abfaeb723caa service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:07.974556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8be9-271d-40f6-b207-abfaeb723caa service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:07.974828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea8be9-271d-40f6-b207-abfaeb723caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:07.984195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea8be9-271d-40f6-b207-abfaeb723caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:07.985942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea8be9-271d-40f6-b207-abfaeb723caa service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:08.013748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 704/1407] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:11.358992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20331852-f6a0-4895-945f-f47a6c2d4e35 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:11.359586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20331852-f6a0-4895-945f-f47a6c2d4e35 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:11.359586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20331852-f6a0-4895-945f-f47a6c2d4e35 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:11.361514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 704/1408] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:11.366829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd10795-fefe-4d8a-882b-34c79783c102 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:11.368542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd10795-fefe-4d8a-882b-34c79783c102 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:11.368542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd10795-fefe-4d8a-882b-34c79783c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:11.389074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2fd10795-fefe-4d8a-882b-34c79783c102 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:11.390342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2fd10795-fefe-4d8a-882b-34c79783c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:11.401503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 705/1409] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:11.444303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20331852-f6a0-4895-945f-f47a6c2d4e35 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:11.460262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20331852-f6a0-4895-945f-f47a6c2d4e35 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:11.466043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a81f0-afa1-4587-a5da-e7b4d5ebf54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:11.469422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a81f0-afa1-4587-a5da-e7b4d5ebf54b service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:11.469832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a81f0-afa1-4587-a5da-e7b4d5ebf54b service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:11.470201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a81f0-afa1-4587-a5da-e7b4d5ebf54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:11.480504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a81f0-afa1-4587-a5da-e7b4d5ebf54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:11.482279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a81f0-afa1-4587-a5da-e7b4d5ebf54b service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:11.494313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 705/1410] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:31.051803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a256-2cdf-46cb-8210-2e2656114e00 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:31.052448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a256-2cdf-46cb-8210-2e2656114e00 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:31.052448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a256-2cdf-46cb-8210-2e2656114e00 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:31.054172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 706/1411] 10.222.0.87 () {54 vars in 918 bytes} [Wed Feb 16 18:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:31.060440 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c421-5a00-4871-898e-440790afc7e0 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:31.063608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c421-5a00-4871-898e-440790afc7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:31.063608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c421-5a00-4871-898e-440790afc7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:31.081298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-91c4c421-5a00-4871-898e-440790afc7e0 None None] MFA Rules not processed for user `6b08679e2a634bf08a279b6d8a9ffc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:31.082499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-91c4c421-5a00-4871-898e-440790afc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:31.091791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 706/1412] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Feb 16 18:13:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:13:31.105908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728635-f9ac-4b96-aeb1-630b65dac054 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:31.106202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728635-f9ac-4b96-aeb1-630b65dac054 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:31.106487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19728635-f9ac-4b96-aeb1-630b65dac054 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:31.108364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 707/1413] 10.222.0.87 () {54 vars in 918 bytes} [Wed Feb 16 18:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:31.113169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f373394-8cae-4b97-9362-8ca77e63cdb0 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:31.113414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f373394-8cae-4b97-9362-8ca77e63cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:31.113693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f373394-8cae-4b97-9362-8ca77e63cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:31.131924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6f373394-8cae-4b97-9362-8ca77e63cdb0 None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:31.133749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6f373394-8cae-4b97-9362-8ca77e63cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:31.143064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 707/1414] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Feb 16 18:13:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:33.932948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3c2e-192f-48fd-87b3-bfd5b277426c None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:33.933541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3c2e-192f-48fd-87b3-bfd5b277426c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:33.933648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f3c2e-192f-48fd-87b3-bfd5b277426c None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:33.935416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 708/1415] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:13:33.940958 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1e83-7a4d-4212-8cff-93ba561a4665 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:33.941414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1e83-7a4d-4212-8cff-93ba561a4665 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:33.941554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac1e83-7a4d-4212-8cff-93ba561a4665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:33.959531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-42ac1e83-7a4d-4212-8cff-93ba561a4665 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:33.960744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-42ac1e83-7a4d-4212-8cff-93ba561a4665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:33.968714 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 708/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:34.011876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3c2e-192f-48fd-87b3-bfd5b277426c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:34.026573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f3c2e-192f-48fd-87b3-bfd5b277426c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:34.031940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8c18-2010-4065-8c53-d3ace54993c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:34.032565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8c18-2010-4065-8c53-d3ace54993c8 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:34.032846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8c18-2010-4065-8c53-d3ace54993c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:34.033172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8c18-2010-4065-8c53-d3ace54993c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:34.042380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8c18-2010-4065-8c53-d3ace54993c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:34.043956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8c18-2010-4065-8c53-d3ace54993c8 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:34.053521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 709/1417] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:35.418094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3486d8-caea-4ed2-bfac-7116933addc6 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:35.418673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3486d8-caea-4ed2-bfac-7116933addc6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:35.418673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3486d8-caea-4ed2-bfac-7116933addc6 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:35.420421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 709/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:35.425699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d20c0-c6f1-4831-926e-79d7ed32e90e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:35.426106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d20c0-c6f1-4831-926e-79d7ed32e90e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:35.426259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d20c0-c6f1-4831-926e-79d7ed32e90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:35.445817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-af8d20c0-c6f1-4831-926e-79d7ed32e90e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:35.447005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-af8d20c0-c6f1-4831-926e-79d7ed32e90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:35.460147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 710/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:35.619144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3486d8-caea-4ed2-bfac-7116933addc6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:35.633057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3486d8-caea-4ed2-bfac-7116933addc6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:35.638359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a27ff-b801-424a-b92a-10f79820fe3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:35.638984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a27ff-b801-424a-b92a-10f79820fe3a service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:35.639262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a27ff-b801-424a-b92a-10f79820fe3a service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:35.639536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a27ff-b801-424a-b92a-10f79820fe3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:35.647358 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a27ff-b801-424a-b92a-10f79820fe3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:35.649034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a27ff-b801-424a-b92a-10f79820fe3a service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:35.658114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 710/1420] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:37.005113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c07a0-502e-492b-816a-36950980c187 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:37.005717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c07a0-502e-492b-816a-36950980c187 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:37.005717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c07a0-502e-492b-816a-36950980c187 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:37.007524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 711/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:37.012818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc97cb-3419-4b53-938e-df0b247651f3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:37.013282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc97cb-3419-4b53-938e-df0b247651f3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:37.013412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc97cb-3419-4b53-938e-df0b247651f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:37.033051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-44dc97cb-3419-4b53-938e-df0b247651f3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:37.034313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-44dc97cb-3419-4b53-938e-df0b247651f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:37.043116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 711/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:37.198929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c07a0-502e-492b-816a-36950980c187 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:37.214817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c07a0-502e-492b-816a-36950980c187 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:37.223588 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa1155-1d16-4d2f-98a3-c06650926e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:37.224246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1155-1d16-4d2f-98a3-c06650926e04 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:37.224553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1155-1d16-4d2f-98a3-c06650926e04 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:37.225453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa1155-1d16-4d2f-98a3-c06650926e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:37.235005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1155-1d16-4d2f-98a3-c06650926e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:37.236607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa1155-1d16-4d2f-98a3-c06650926e04 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:37.247490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 712/1423] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:13:38.578948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1708e-c2ab-4d50-b603-d5fde671eadb None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:38.579507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1708e-c2ab-4d50-b603-d5fde671eadb None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:38.579612 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1708e-c2ab-4d50-b603-d5fde671eadb None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:38.581370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 712/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:38.586890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba197c9-51a2-4051-a6f3-205507e54eed None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:38.587362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba197c9-51a2-4051-a6f3-205507e54eed None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:38.587467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba197c9-51a2-4051-a6f3-205507e54eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:38.605428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-dba197c9-51a2-4051-a6f3-205507e54eed None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:38.606614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dba197c9-51a2-4051-a6f3-205507e54eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:38.614504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 713/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:38.771121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1708e-c2ab-4d50-b603-d5fde671eadb None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:38.786102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1708e-c2ab-4d50-b603-d5fde671eadb None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:38.792270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985950e-64fa-4401-b6a7-0cb27aa7cb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:38.792916 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985950e-64fa-4401-b6a7-0cb27aa7cb43 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:38.793232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985950e-64fa-4401-b6a7-0cb27aa7cb43 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:38.793512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985950e-64fa-4401-b6a7-0cb27aa7cb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:38.802261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985950e-64fa-4401-b6a7-0cb27aa7cb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:38.803841 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985950e-64fa-4401-b6a7-0cb27aa7cb43 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:38.814541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 713/1426] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:40.144410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1165-9c3b-4058-aba3-8072cd376e05 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:40.144987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1165-9c3b-4058-aba3-8072cd376e05 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:40.145377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1165-9c3b-4058-aba3-8072cd376e05 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:40.147261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 714/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:40.152468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8488c-27a8-47bc-b2d2-e4cdd07e7159 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:40.152910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8488c-27a8-47bc-b2d2-e4cdd07e7159 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:40.153040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8488c-27a8-47bc-b2d2-e4cdd07e7159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:40.171597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-97b8488c-27a8-47bc-b2d2-e4cdd07e7159 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:40.172797 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-97b8488c-27a8-47bc-b2d2-e4cdd07e7159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:40.181517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 714/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:40.334100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1165-9c3b-4058-aba3-8072cd376e05 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:40.349472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1165-9c3b-4058-aba3-8072cd376e05 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:40.356061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b01ef-591c-4fa5-b9a6-ba92c8e44f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:40.356719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b01ef-591c-4fa5-b9a6-ba92c8e44f04 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:40.357004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b01ef-591c-4fa5-b9a6-ba92c8e44f04 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:40.357339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b01ef-591c-4fa5-b9a6-ba92c8e44f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:40.366137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b01ef-591c-4fa5-b9a6-ba92c8e44f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:40.368735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b01ef-591c-4fa5-b9a6-ba92c8e44f04 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:40.378938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 715/1429] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:41.716733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb15d23-6898-4003-8a69-fe6f058ad632 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:41.717336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb15d23-6898-4003-8a69-fe6f058ad632 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:41.717336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb15d23-6898-4003-8a69-fe6f058ad632 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:41.719126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 715/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:41.724402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfdf2-af7f-476c-9f5c-f5a6cb7cd72c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:41.724815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfdf2-af7f-476c-9f5c-f5a6cb7cd72c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:41.724948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dfdf2-af7f-476c-9f5c-f5a6cb7cd72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:41.744879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ea0dfdf2-af7f-476c-9f5c-f5a6cb7cd72c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:41.746090 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ea0dfdf2-af7f-476c-9f5c-f5a6cb7cd72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:41.753865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 716/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:41.907014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb15d23-6898-4003-8a69-fe6f058ad632 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:41.922061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb15d23-6898-4003-8a69-fe6f058ad632 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:41.927895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bee823-3961-40b7-8932-6c19c8a1b704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:41.928609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bee823-3961-40b7-8932-6c19c8a1b704 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:41.928899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bee823-3961-40b7-8932-6c19c8a1b704 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:41.929207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bee823-3961-40b7-8932-6c19c8a1b704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:41.939244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bee823-3961-40b7-8932-6c19c8a1b704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:41.941253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bee823-3961-40b7-8932-6c19c8a1b704 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:41.953807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 716/1432] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:43.388056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16fd6-6847-489d-bb43-269dcdfa62da None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:43.388625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16fd6-6847-489d-bb43-269dcdfa62da None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:43.388625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16fd6-6847-489d-bb43-269dcdfa62da None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:43.390407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 717/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:43.395581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ef1cb-5e9f-45af-a4b5-6377ec5f04b4 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:43.396029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ef1cb-5e9f-45af-a4b5-6377ec5f04b4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:43.396145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ef1cb-5e9f-45af-a4b5-6377ec5f04b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:43.414952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-756ef1cb-5e9f-45af-a4b5-6377ec5f04b4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:43.416155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-756ef1cb-5e9f-45af-a4b5-6377ec5f04b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:43.424433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 717/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:43.582209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f16fd6-6847-489d-bb43-269dcdfa62da None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:43.597626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f16fd6-6847-489d-bb43-269dcdfa62da None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:43.603802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cec3f-5f91-4ee2-8e30-95aa80ae8e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:43.604450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cec3f-5f91-4ee2-8e30-95aa80ae8e92 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:43.604731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cec3f-5f91-4ee2-8e30-95aa80ae8e92 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:43.605008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cec3f-5f91-4ee2-8e30-95aa80ae8e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:43.614536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cec3f-5f91-4ee2-8e30-95aa80ae8e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:43.616121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cec3f-5f91-4ee2-8e30-95aa80ae8e92 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:43.626098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 718/1435] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:45.006695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8770ab-0d83-4a42-9ce6-d38e914197e5 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:45.007379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8770ab-0d83-4a42-9ce6-d38e914197e5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:45.007379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8770ab-0d83-4a42-9ce6-d38e914197e5 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:45.009893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 718/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:45.015409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aab77-33d1-4403-aa11-a9e3dbf2c695 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:45.015905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aab77-33d1-4403-aa11-a9e3dbf2c695 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:45.016013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aab77-33d1-4403-aa11-a9e3dbf2c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:45.036031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-968aab77-33d1-4403-aa11-a9e3dbf2c695 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:45.037254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-968aab77-33d1-4403-aa11-a9e3dbf2c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:45.045814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 719/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:45.201808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8770ab-0d83-4a42-9ce6-d38e914197e5 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:45.217846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8770ab-0d83-4a42-9ce6-d38e914197e5 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:45.223363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd85a6-3cc5-445e-93d9-3303410b6857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:45.224022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd85a6-3cc5-445e-93d9-3303410b6857 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:45.224311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd85a6-3cc5-445e-93d9-3303410b6857 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:45.224591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd85a6-3cc5-445e-93d9-3303410b6857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:45.234514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd85a6-3cc5-445e-93d9-3303410b6857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:45.236116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd85a6-3cc5-445e-93d9-3303410b6857 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:45.246971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 719/1438] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:46.617884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195810e-8ae0-44e6-b833-3cfa9edf0f68 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:46.618626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195810e-8ae0-44e6-b833-3cfa9edf0f68 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:46.618626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195810e-8ae0-44e6-b833-3cfa9edf0f68 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:46.620337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 720/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:46.626646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14437af-668d-4350-9c73-b7fabc783019 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:46.626646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14437af-668d-4350-9c73-b7fabc783019 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:46.626646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14437af-668d-4350-9c73-b7fabc783019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:46.644835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c14437af-668d-4350-9c73-b7fabc783019 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:46.646085 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c14437af-668d-4350-9c73-b7fabc783019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:46.654105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 720/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:46.816413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195810e-8ae0-44e6-b833-3cfa9edf0f68 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:46.831537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195810e-8ae0-44e6-b833-3cfa9edf0f68 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:46.837594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebb904-9b03-4cab-977d-b68d4d905993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:46.838772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebb904-9b03-4cab-977d-b68d4d905993 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:46.839051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebb904-9b03-4cab-977d-b68d4d905993 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:46.839321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebb904-9b03-4cab-977d-b68d4d905993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:46.848065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebb904-9b03-4cab-977d-b68d4d905993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:46.849707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebb904-9b03-4cab-977d-b68d4d905993 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:46.859816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 721/1441] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:49.137702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e383-372f-4884-aaae-c39e95ed1a2a None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:49.138257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e383-372f-4884-aaae-c39e95ed1a2a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:49.138257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e383-372f-4884-aaae-c39e95ed1a2a None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:49.140112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 721/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:49.145981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1051-859f-43b6-85c5-650cb1ed84de None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:49.146481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1051-859f-43b6-85c5-650cb1ed84de None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:49.146592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe1051-859f-43b6-85c5-650cb1ed84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:49.165440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-dffe1051-859f-43b6-85c5-650cb1ed84de None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:49.170811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dffe1051-859f-43b6-85c5-650cb1ed84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:49.174578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 722/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:49.217791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9e383-372f-4884-aaae-c39e95ed1a2a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:49.232440 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9e383-372f-4884-aaae-c39e95ed1a2a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:49.238124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbeaa9-a785-456d-9234-6d6fec3c3eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:49.239257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbeaa9-a785-456d-9234-6d6fec3c3eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:49.239738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbeaa9-a785-456d-9234-6d6fec3c3eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:49.240196 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbeaa9-a785-456d-9234-6d6fec3c3eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:49.251423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbeaa9-a785-456d-9234-6d6fec3c3eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:49.256939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbeaa9-a785-456d-9234-6d6fec3c3eb5 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:49.264442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 722/1444] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:13:51.806770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf2c1-1564-434b-a112-db683ad1adc8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:51.807383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf2c1-1564-434b-a112-db683ad1adc8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:51.807383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf2c1-1564-434b-a112-db683ad1adc8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:51.809192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 723/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:51.814657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865811e-dc6e-4147-8e1d-e9e2499fd4cd None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:51.815103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865811e-dc6e-4147-8e1d-e9e2499fd4cd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:51.815205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865811e-dc6e-4147-8e1d-e9e2499fd4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:51.834252 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-a865811e-dc6e-4147-8e1d-e9e2499fd4cd None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:51.835505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a865811e-dc6e-4147-8e1d-e9e2499fd4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:51.843413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 723/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:51.883291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbf2c1-1564-434b-a112-db683ad1adc8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:51.893945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbf2c1-1564-434b-a112-db683ad1adc8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:51.897594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e4a5f-fb75-428c-a56d-10f0bd3db208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:51.898391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4a5f-fb75-428c-a56d-10f0bd3db208 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:51.898784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4a5f-fb75-428c-a56d-10f0bd3db208 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:51.899079 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e4a5f-fb75-428c-a56d-10f0bd3db208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:51.908176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e4a5f-fb75-428c-a56d-10f0bd3db208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:51.909647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e4a5f-fb75-428c-a56d-10f0bd3db208 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:51.919531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 724/1447] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:54.604673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd6d1-6dba-47d0-882a-43aec69c718d None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:54.605239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd6d1-6dba-47d0-882a-43aec69c718d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:54.605239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befd6d1-6dba-47d0-882a-43aec69c718d None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:54.606963 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 724/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:54.612270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e54e5-21cc-47d0-a808-85b5fe6c00ba None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:54.612739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e54e5-21cc-47d0-a808-85b5fe6c00ba None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:54.612867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e54e5-21cc-47d0-a808-85b5fe6c00ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:54.630306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ee5e54e5-21cc-47d0-a808-85b5fe6c00ba None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:54.631515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ee5e54e5-21cc-47d0-a808-85b5fe6c00ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:54.639990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 725/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:54.679866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befd6d1-6dba-47d0-882a-43aec69c718d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:54.690881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befd6d1-6dba-47d0-882a-43aec69c718d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:54.694425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55d15c-4b9c-4144-b15e-6a7056ed171a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:54.695694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d15c-4b9c-4144-b15e-6a7056ed171a service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:54.696128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d15c-4b9c-4144-b15e-6a7056ed171a service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:54.696417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d15c-4b9c-4144-b15e-6a7056ed171a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:54.705812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55d15c-4b9c-4144-b15e-6a7056ed171a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:54.707229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55d15c-4b9c-4144-b15e-6a7056ed171a service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:54.717010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 725/1450] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:13:57.258327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020157aa-bffc-4f10-b43d-2e919afd9951 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:57.258950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020157aa-bffc-4f10-b43d-2e919afd9951 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:57.258950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020157aa-bffc-4f10-b43d-2e919afd9951 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:57.261038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 726/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:57.266934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c555b-cc1f-4545-8fc1-9ce62a522f6a None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:57.267498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c555b-cc1f-4545-8fc1-9ce62a522f6a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:57.267498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c555b-cc1f-4545-8fc1-9ce62a522f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:57.286616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-784c555b-cc1f-4545-8fc1-9ce62a522f6a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:57.287824 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-784c555b-cc1f-4545-8fc1-9ce62a522f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:57.296825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 726/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:57.338017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020157aa-bffc-4f10-b43d-2e919afd9951 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:57.353097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020157aa-bffc-4f10-b43d-2e919afd9951 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:57.356862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb474a-711a-4bf9-b770-64297565c05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:57.357614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb474a-711a-4bf9-b770-64297565c05a service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:57.357900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb474a-711a-4bf9-b770-64297565c05a service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:57.358168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb474a-711a-4bf9-b770-64297565c05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:57.369276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb474a-711a-4bf9-b770-64297565c05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:57.370725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb474a-711a-4bf9-b770-64297565c05a service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:57.380772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 727/1453] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:13:59.798382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d484be-0adf-44a7-b801-18badae2a18a None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:59.798936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d484be-0adf-44a7-b801-18badae2a18a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:59.798936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d484be-0adf-44a7-b801-18badae2a18a None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:59.800744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 727/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:13:59.806823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51947b0-3862-4acd-8466-b73564065d06 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:59.807323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51947b0-3862-4acd-8466-b73564065d06 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:59.807425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51947b0-3862-4acd-8466-b73564065d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:59.826476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e51947b0-3862-4acd-8466-b73564065d06 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:13:59.827672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e51947b0-3862-4acd-8466-b73564065d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:59.836300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 728/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:13:59.874982 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d484be-0adf-44a7-b801-18badae2a18a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:13:59.876866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f4d484be-0adf-44a7-b801-18badae2a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:13:59.891627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d484be-0adf-44a7-b801-18badae2a18a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:13:59.895293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1526f-94d5-4aa8-ad73-47dcd04ac13b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:13:59.895943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1526f-94d5-4aa8-ad73-47dcd04ac13b service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:13:59.896229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1526f-94d5-4aa8-ad73-47dcd04ac13b service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:13:59.896508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1526f-94d5-4aa8-ad73-47dcd04ac13b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:13:59.908574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1526f-94d5-4aa8-ad73-47dcd04ac13b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:13:59.910998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1526f-94d5-4aa8-ad73-47dcd04ac13b service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:13:59.923272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 728/1456] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:02.383332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc813e-0854-408a-a4fd-31771f95d4f1 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:02.383901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc813e-0854-408a-a4fd-31771f95d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:02.383901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc813e-0854-408a-a4fd-31771f95d4f1 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:02.385674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 729/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:02.391050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4bcf-1f57-4b1c-bb0d-f720ab93f5ea None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:02.391479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4bcf-1f57-4b1c-bb0d-f720ab93f5ea None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:02.391584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4bcf-1f57-4b1c-bb0d-f720ab93f5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:02.409145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-a75e4bcf-1f57-4b1c-bb0d-f720ab93f5ea None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:02.410371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a75e4bcf-1f57-4b1c-bb0d-f720ab93f5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:02.418384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 729/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:02.458195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc813e-0854-408a-a4fd-31771f95d4f1 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:02.470446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc813e-0854-408a-a4fd-31771f95d4f1 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:02.477402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a01aa-8515-4362-9c42-99c34c1454a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:02.478055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a01aa-8515-4362-9c42-99c34c1454a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:02.478340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a01aa-8515-4362-9c42-99c34c1454a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:02.478616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a01aa-8515-4362-9c42-99c34c1454a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:02.488087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a01aa-8515-4362-9c42-99c34c1454a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:02.489577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a01aa-8515-4362-9c42-99c34c1454a1 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:02.499578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 730/1459] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:04.880345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966101e-0b9c-47b9-974b-ecfb3a8d1cac None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:04.880893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966101e-0b9c-47b9-974b-ecfb3a8d1cac None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:04.880893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966101e-0b9c-47b9-974b-ecfb3a8d1cac None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:04.883448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 730/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:04.888912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ddcb-7a35-4a01-ac2f-acd0e41444b9 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:04.889367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ddcb-7a35-4a01-ac2f-acd0e41444b9 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:04.889508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ddcb-7a35-4a01-ac2f-acd0e41444b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:04.907874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8721ddcb-7a35-4a01-ac2f-acd0e41444b9 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:04.909056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8721ddcb-7a35-4a01-ac2f-acd0e41444b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:04.916962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 731/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:04.955708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966101e-0b9c-47b9-974b-ecfb3a8d1cac None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:04.967079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966101e-0b9c-47b9-974b-ecfb3a8d1cac None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:04.970724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c2816-cd1a-4ca7-a6ff-aee6d59a49a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:04.971360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c2816-cd1a-4ca7-a6ff-aee6d59a49a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:04.971643 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c2816-cd1a-4ca7-a6ff-aee6d59a49a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:04.971920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c2816-cd1a-4ca7-a6ff-aee6d59a49a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:04.980945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c2816-cd1a-4ca7-a6ff-aee6d59a49a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:04.982389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c2816-cd1a-4ca7-a6ff-aee6d59a49a3 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:04.991491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 731/1462] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:07.419429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde79e11-73c4-4440-b590-245a4106d085 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:07.419987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde79e11-73c4-4440-b590-245a4106d085 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:07.419987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde79e11-73c4-4440-b590-245a4106d085 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:07.421803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 732/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:07.427086 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596598cd-6d73-4937-a96e-652da3674fa9 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:07.427554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596598cd-6d73-4937-a96e-652da3674fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:07.427661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596598cd-6d73-4937-a96e-652da3674fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:07.446700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-596598cd-6d73-4937-a96e-652da3674fa9 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:07.447902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-596598cd-6d73-4937-a96e-652da3674fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:07.455808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 732/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:07.495125 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde79e11-73c4-4440-b590-245a4106d085 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:07.505956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde79e11-73c4-4440-b590-245a4106d085 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:07.509932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62ff2e-a924-49d8-8080-7cbf503bd2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:07.510577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62ff2e-a924-49d8-8080-7cbf503bd2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:07.510860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62ff2e-a924-49d8-8080-7cbf503bd2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:07.511136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62ff2e-a924-49d8-8080-7cbf503bd2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:07.520413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62ff2e-a924-49d8-8080-7cbf503bd2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:07.521897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62ff2e-a924-49d8-8080-7cbf503bd2f1 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:07.532555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 733/1465] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:09.899591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792c66-39a1-4f90-ba1c-33f1879efa63 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:09.900161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792c66-39a1-4f90-ba1c-33f1879efa63 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:09.900161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792c66-39a1-4f90-ba1c-33f1879efa63 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:09.901976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 733/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:09.907369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879567ba-8195-405f-b172-6d0f1d191f40 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:09.907813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879567ba-8195-405f-b172-6d0f1d191f40 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:09.907930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879567ba-8195-405f-b172-6d0f1d191f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:09.925451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-879567ba-8195-405f-b172-6d0f1d191f40 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:09.926627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-879567ba-8195-405f-b172-6d0f1d191f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:09.934985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 734/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:09.972565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792c66-39a1-4f90-ba1c-33f1879efa63 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:09.984003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792c66-39a1-4f90-ba1c-33f1879efa63 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:09.987574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820ce22-e88e-435d-a95f-627d06cc7019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:09.988225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820ce22-e88e-435d-a95f-627d06cc7019 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:09.988508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820ce22-e88e-435d-a95f-627d06cc7019 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:09.988783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820ce22-e88e-435d-a95f-627d06cc7019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:09.999491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820ce22-e88e-435d-a95f-627d06cc7019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:10.001007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820ce22-e88e-435d-a95f-627d06cc7019 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:10.012375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 734/1468] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:12.360169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca8322-9dc7-4b62-8619-50b1dd462695 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:12.360724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca8322-9dc7-4b62-8619-50b1dd462695 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:12.360724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca8322-9dc7-4b62-8619-50b1dd462695 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:12.362522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 735/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:12.368252 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbecc4-974f-4877-93a7-e5910a3b18ee None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:12.369475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbecc4-974f-4877-93a7-e5910a3b18ee None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:12.369475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbecc4-974f-4877-93a7-e5910a3b18ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:12.387422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2acbecc4-974f-4877-93a7-e5910a3b18ee None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:12.388628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2acbecc4-974f-4877-93a7-e5910a3b18ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:12.398199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 735/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:12.435429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca8322-9dc7-4b62-8619-50b1dd462695 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:12.446244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca8322-9dc7-4b62-8619-50b1dd462695 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:12.449844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4fd86-51c3-460d-8ce9-b8619ac09e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:12.450418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4fd86-51c3-460d-8ce9-b8619ac09e9c service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:12.450701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4fd86-51c3-460d-8ce9-b8619ac09e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:12.450977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4fd86-51c3-460d-8ce9-b8619ac09e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:12.459873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4fd86-51c3-460d-8ce9-b8619ac09e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:12.461983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4fd86-51c3-460d-8ce9-b8619ac09e9c service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:12.471451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 736/1471] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:33.709932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8cdfd-1113-4de1-9795-2efddea6d5a1 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:33.710526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8cdfd-1113-4de1-9795-2efddea6d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:33.710526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8cdfd-1113-4de1-9795-2efddea6d5a1 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:33.712322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 736/1472] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:33.717807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0436-0c2d-4284-b5b5-34b731d61e28 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:33.718354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0436-0c2d-4284-b5b5-34b731d61e28 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:33.718354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f0436-0c2d-4284-b5b5-34b731d61e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:33.737298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c42f0436-0c2d-4284-b5b5-34b731d61e28 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:33.738526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c42f0436-0c2d-4284-b5b5-34b731d61e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:33.754468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 737/1473] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:33.801815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1dbc-5511-4922-bdc4-fd8429dff12d None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:33.802104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1dbc-5511-4922-bdc4-fd8429dff12d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:33.802391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d1dbc-5511-4922-bdc4-fd8429dff12d None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:33.804861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 737/1474] 10.222.0.87 () {54 vars in 962 bytes} [Wed Feb 16 18:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:33.810197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba4fde-3f20-4de4-9e49-7dc226bb484a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:33.810488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba4fde-3f20-4de4-9e49-7dc226bb484a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:33.810766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba4fde-3f20-4de4-9e49-7dc226bb484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:33.828767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-87ba4fde-3f20-4de4-9e49-7dc226bb484a None None] MFA Rules not processed for user `715e34300eef47d9aa2839cb3c5c5fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:33.829969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-87ba4fde-3f20-4de4-9e49-7dc226bb484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:33.836316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 738/1475] 10.222.0.87 () {58 vars in 1059 bytes} [Wed Feb 16 18:14:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:33.843363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d1dbc-5511-4922-bdc4-fd8429dff12d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:33.854470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d1dbc-5511-4922-bdc4-fd8429dff12d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:33.858018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ac675-a50c-4c26-acdf-8fc2a39f17a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:33.858585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac675-a50c-4c26-acdf-8fc2a39f17a9 service glance] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:33.858865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac675-a50c-4c26-acdf-8fc2a39f17a9 service glance] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:33.859138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ac675-a50c-4c26-acdf-8fc2a39f17a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:33.868588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac675-a50c-4c26-acdf-8fc2a39f17a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:33.870039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ac675-a50c-4c26-acdf-8fc2a39f17a9 service glance] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:33.879037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 738/1476] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:36.309061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf294e5-0cba-4266-addd-0995aa38aaa8 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:36.309641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf294e5-0cba-4266-addd-0995aa38aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:36.309641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf294e5-0cba-4266-addd-0995aa38aaa8 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:36.311407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 739/1477] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:36.316941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946ed4-c8e8-418d-ab02-b45510532546 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:36.317464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946ed4-c8e8-418d-ab02-b45510532546 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:36.317559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33946ed4-c8e8-418d-ab02-b45510532546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:36.336136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-33946ed4-c8e8-418d-ab02-b45510532546 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:36.337383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-33946ed4-c8e8-418d-ab02-b45510532546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:36.345312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 739/1478] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:36.368717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf294e5-0cba-4266-addd-0995aa38aaa8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:36.380811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf294e5-0cba-4266-addd-0995aa38aaa8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:36.385508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979492a6-5945-4106-bd5d-5af9c8630a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:36.386150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979492a6-5945-4106-bd5d-5af9c8630a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:36.386433 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979492a6-5945-4106-bd5d-5af9c8630a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:36.386702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979492a6-5945-4106-bd5d-5af9c8630a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:36.387420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979492a6-5945-4106-bd5d-5af9c8630a1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:36.389298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979492a6-5945-4106-bd5d-5af9c8630a1d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:36.403741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 740/1479] 10.222.0.87 () {56 vars in 1108 bytes} [Wed Feb 16 18:14:36 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:14:38.799338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc2f33-415d-4a89-adda-8e2f704ca300 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:38.800207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc2f33-415d-4a89-adda-8e2f704ca300 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:38.800207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc2f33-415d-4a89-adda-8e2f704ca300 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:38.802569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 740/1480] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:38.808975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008a56e-00af-4f37-b283-6058621e619e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:38.809432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008a56e-00af-4f37-b283-6058621e619e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:38.809582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008a56e-00af-4f37-b283-6058621e619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:38.828848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1008a56e-00af-4f37-b283-6058621e619e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:38.830100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1008a56e-00af-4f37-b283-6058621e619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:38.838006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 741/1481] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:38.879852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc2f33-415d-4a89-adda-8e2f704ca300 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:38.894296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc2f33-415d-4a89-adda-8e2f704ca300 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:38.899903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea8c00-0b1d-4a97-8a1e-2129cca0dea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:38.900533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea8c00-0b1d-4a97-8a1e-2129cca0dea2 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:38.900813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea8c00-0b1d-4a97-8a1e-2129cca0dea2 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:38.901093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea8c00-0b1d-4a97-8a1e-2129cca0dea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:38.909013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea8c00-0b1d-4a97-8a1e-2129cca0dea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:38.910602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea8c00-0b1d-4a97-8a1e-2129cca0dea2 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:38.919826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 741/1482] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:41.400448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb58b-927d-495f-97b0-05ef38cec603 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:41.401037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb58b-927d-495f-97b0-05ef38cec603 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:41.401037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb58b-927d-495f-97b0-05ef38cec603 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:41.402892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 742/1483] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:41.408296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cf696-b7e9-440d-8964-0bb29d14d234 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:41.408716 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cf696-b7e9-440d-8964-0bb29d14d234 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:41.408855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cf696-b7e9-440d-8964-0bb29d14d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:41.426908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-727cf696-b7e9-440d-8964-0bb29d14d234 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:41.428081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-727cf696-b7e9-440d-8964-0bb29d14d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:41.436311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 742/1484] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:41.472049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb58b-927d-495f-97b0-05ef38cec603 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:41.483534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb58b-927d-495f-97b0-05ef38cec603 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:41.487078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3eac-fee0-45af-b512-10cf4b695acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:41.487717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3eac-fee0-45af-b512-10cf4b695acc service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:41.488002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3eac-fee0-45af-b512-10cf4b695acc service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:41.488281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3eac-fee0-45af-b512-10cf4b695acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:41.497968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3eac-fee0-45af-b512-10cf4b695acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:41.499414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3eac-fee0-45af-b512-10cf4b695acc service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:41.508879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 743/1485] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:43.889581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625645d-3452-49e3-b08b-797c97f9c5c9 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:43.890149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625645d-3452-49e3-b08b-797c97f9c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:43.890267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625645d-3452-49e3-b08b-797c97f9c5c9 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:43.892271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 743/1486] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:43.898237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d789-7248-41a8-baab-4e61ed8bebcb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:43.898931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d789-7248-41a8-baab-4e61ed8bebcb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:43.899074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d789-7248-41a8-baab-4e61ed8bebcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:43.918059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e6a0d789-7248-41a8-baab-4e61ed8bebcb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:43.919247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e6a0d789-7248-41a8-baab-4e61ed8bebcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:43.930295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 744/1487] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:43.969195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625645d-3452-49e3-b08b-797c97f9c5c9 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:43.980284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625645d-3452-49e3-b08b-797c97f9c5c9 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:43.983826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22fc0c-e325-4353-91b6-33f7e14b55e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:43.984456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22fc0c-e325-4353-91b6-33f7e14b55e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:43.984736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22fc0c-e325-4353-91b6-33f7e14b55e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:43.985009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22fc0c-e325-4353-91b6-33f7e14b55e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:43.994119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22fc0c-e325-4353-91b6-33f7e14b55e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:43.995524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22fc0c-e325-4353-91b6-33f7e14b55e6 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:44.004614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 744/1488] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:46.570771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2aaac-2ee9-4005-b53e-3245a220b2df None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:46.571334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2aaac-2ee9-4005-b53e-3245a220b2df None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:46.571334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2aaac-2ee9-4005-b53e-3245a220b2df None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:46.573169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 745/1489] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:14:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:14:46.578561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aeb9f-c65e-47ba-b193-cafa23b2f9f4 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:46.579023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aeb9f-c65e-47ba-b193-cafa23b2f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:46.579168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aeb9f-c65e-47ba-b193-cafa23b2f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:46.598070 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2f5aeb9f-c65e-47ba-b193-cafa23b2f9f4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:46.599284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2f5aeb9f-c65e-47ba-b193-cafa23b2f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:46.607377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 745/1490] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:14:46.649999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2aaac-2ee9-4005-b53e-3245a220b2df None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:46.660606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2aaac-2ee9-4005-b53e-3245a220b2df None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:46.664322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83221-cf80-4d6d-9d3b-2bcf3a3b3bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:46.664954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83221-cf80-4d6d-9d3b-2bcf3a3b3bda service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:46.665273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83221-cf80-4d6d-9d3b-2bcf3a3b3bda service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:46.665550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83221-cf80-4d6d-9d3b-2bcf3a3b3bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:46.674592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83221-cf80-4d6d-9d3b-2bcf3a3b3bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:46.676019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83221-cf80-4d6d-9d3b-2bcf3a3b3bda service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:46.686472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 746/1491] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:14:49.478646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd1af-cc9f-49eb-847f-762c31329548 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:49.479176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd1af-cc9f-49eb-847f-762c31329548 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:49.479176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd1af-cc9f-49eb-847f-762c31329548 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:49.480911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 746/1492] 10.222.0.87 () {54 vars in 926 bytes} [Wed Feb 16 18:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:14:49.487095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d282cf-319f-49cd-b0b4-a81b9b8b1e22 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:49.487557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d282cf-319f-49cd-b0b4-a81b9b8b1e22 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:49.487649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d282cf-319f-49cd-b0b4-a81b9b8b1e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:49.506381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e7d282cf-319f-49cd-b0b4-a81b9b8b1e22 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:14:49.508324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e7d282cf-319f-49cd-b0b4-a81b9b8b1e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:14:49.516250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 747/1493] 10.222.0.87 () {58 vars in 1023 bytes} [Wed Feb 16 18:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:14:49.557209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dd1af-cc9f-49eb-847f-762c31329548 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:14:49.568539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dd1af-cc9f-49eb-847f-762c31329548 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:14:49.573353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e3e88-9bd4-4198-bbf8-b9c6e720ca10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:14:49.574036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e3e88-9bd4-4198-bbf8-b9c6e720ca10 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:14:49.574317 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e3e88-9bd4-4198-bbf8-b9c6e720ca10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:14:49.574589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e3e88-9bd4-4198-bbf8-b9c6e720ca10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:14:49.584218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e3e88-9bd4-4198-bbf8-b9c6e720ca10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:14:49.586479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e3e88-9bd4-4198-bbf8-b9c6e720ca10 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:14:49.595939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 747/1494] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:16:25.553579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4a3c-6cb7-4f19-b02c-9b6260bcd8c6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:25.554195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4a3c-6cb7-4f19-b02c-9b6260bcd8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:25.554195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4a3c-6cb7-4f19-b02c-9b6260bcd8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:25.579986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-fd8e4a3c-6cb7-4f19-b02c-9b6260bcd8c6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:16:25.581891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fd8e4a3c-6cb7-4f19-b02c-9b6260bcd8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:16:25.594323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 748/1495] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:16:25.603650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb57f6-da62-4f28-b980-faacb78f29d2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:25.604232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb57f6-da62-4f28-b980-faacb78f29d2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:25.604645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb57f6-da62-4f28-b980-faacb78f29d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:25.624144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6deb57f6-da62-4f28-b980-faacb78f29d2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:16:25.625326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6deb57f6-da62-4f28-b980-faacb78f29d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:16:25.633187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 748/1496] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:16:25.637957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4a3c-6cb7-4f19-b02c-9b6260bcd8c6 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:25.647708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4a3c-6cb7-4f19-b02c-9b6260bcd8c6 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:25.652240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:25.653050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:25.653050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:25.654375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:25.655113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:16:25.655408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:25.657029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:25.669032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 749/1497] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:16:25.679296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb57f6-da62-4f28-b980-faacb78f29d2 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:25.694635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb57f6-da62-4f28-b980-faacb78f29d2 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:25.699302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:25.700020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:25.700302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:25.700575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:25.701445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:25.703254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:25.804150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 749/1498] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:16:25 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:16:25.808014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:25.818127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7bddf-1dec-494a-bbc0-e8bdc3511f58 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:25.874199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:25.874873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:25.875177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:25.875510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:25.876218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:25.878193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:25.999154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 750/1499] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:16:25 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:16:26.003713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:26.014973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6b608-250c-41ad-a0f1-054c2ae73c74 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:26.027406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:26.028081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.028361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.028632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.030269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:26.031970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:26.048799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 750/1500] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:16:26.053464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:26.068695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad51ea8-e663-4507-b5a0-90acf59b0c57 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:26.073666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371d24-d5e8-4ce2-bf60-22bcac0c69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:26.074332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371d24-d5e8-4ce2-bf60-22bcac0c69b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.074621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371d24-d5e8-4ce2-bf60-22bcac0c69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.074898 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371d24-d5e8-4ce2-bf60-22bcac0c69b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.075620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d371d24-d5e8-4ce2-bf60-22bcac0c69b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:26.078032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d371d24-d5e8-4ce2-bf60-22bcac0c69b9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:26.093099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 751/1501] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:16:26.097481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:26.108347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328368-1a2f-4412-9b06-48cf2ef1e991 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:26.113452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:26.114355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.114639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.114914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] PATH_INFO: `/v3/projects/a3af70fed3384af6a03e00ad3f28b8ca/users/983a1591c5df43188377145d1c024a33/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.130816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3af70fed3384af6a03e00ad3f28b8ca, user_id=983a1591c5df43188377145d1c024a33, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:26.133760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:26.203482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 751/1502] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:16:26 2022] PUT /identity/v3/projects/a3af70fed3384af6a03e00ad3f28b8ca/users/983a1591c5df43188377145d1c024a33/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:16:26.216281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6291dc-d3b3-49e3-86f5-a11ce9a3012d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.217270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6291dc-d3b3-49e3-86f5-a11ce9a3012d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.217556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6291dc-d3b3-49e3-86f5-a11ce9a3012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.244770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1c6291dc-d3b3-49e3-86f5-a11ce9a3012d None None] MFA Rules not processed for user `983a1591c5df43188377145d1c024a33`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:16:26.246012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1c6291dc-d3b3-49e3-86f5-a11ce9a3012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:16:26.315454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 752/1503] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:16:26.329502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:26.405461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb345db-4292-4357-948b-82fcdcfca2b3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:26.411028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:26.411700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.411987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.412269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.421526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:26.423134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:26.432606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 752/1504] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:16:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:16:26.508796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a2250-898a-4f50-8eb8-5e79864f7145 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.509111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a2250-898a-4f50-8eb8-5e79864f7145 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.509468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a2250-898a-4f50-8eb8-5e79864f7145 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.511212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 753/1505] 10.222.0.87 () {52 vars in 829 bytes} [Wed Feb 16 18:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:16:26.516403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:26.581637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70598be-f3db-43f8-9df1-61e1f5990fb4 service nova] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:26.586144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:26.587125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.587409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.587691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] PATH_INFO: `/v3/users/983a1591c5df43188377145d1c024a33` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.588912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=983a1591c5df43188377145d1c024a33)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:26.589998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:16:26.589998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:16:26.589998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:16:26.591202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:26.825829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983a1591c5df43188377145d1c024a33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:26.827024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983a1591c5df43188377145d1c024a33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:26.846505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983a1591c5df43188377145d1c024a33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:26.847302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983a1591c5df43188377145d1c024a33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:26.860803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983a1591c5df43188377145d1c024a33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:26.938243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 753/1506] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:16:26 2022] DELETE /identity/v3/users/983a1591c5df43188377145d1c024a33 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:16:26.942836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:26.943342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:26.943474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:26.963599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:16:26.964822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:16:27.024984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 754/1507] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:16:27.036449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:27.037923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:16:27.104181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7c5af-f1bf-4118-91a2-b6881764a3c7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:27.108430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebbbd6-9ce3-466d-a357-6d9706ff2779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:27.109143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebbbd6-9ce3-466d-a357-6d9706ff2779 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:27.109434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebbbd6-9ce3-466d-a357-6d9706ff2779 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:27.109712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebbbd6-9ce3-466d-a357-6d9706ff2779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:27.119710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebbbd6-9ce3-466d-a357-6d9706ff2779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:27.121189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebbbd6-9ce3-466d-a357-6d9706ff2779 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:27.134814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 754/1508] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:16:27.606779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:16:27.608914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:16:27.621071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65379-6422-47fe-a476-03bf155ba17f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:16:27.626244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:16:27.628003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:16:27.628286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:16:27.629095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] PATH_INFO: `/v3/projects/a3af70fed3384af6a03e00ad3f28b8ca` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:16:27.630367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3af70fed3384af6a03e00ad3f28b8ca)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:16:27.631414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:16:27.631414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:16:27.631414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:16:27.633803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:16:27.758608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3af70fed3384af6a03e00ad3f28b8ca', 'request_id': 'req-e874fba2-e783-4124-ae29-0e6b4b393202'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:27.823965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3af70fed3384af6a03e00ad3f28b8ca', 'request_id': 'req-e874fba2-e783-4124-ae29-0e6b4b393202'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:27.831921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3af70fed3384af6a03e00ad3f28b8ca', 'request_id': 'req-e874fba2-e783-4124-ae29-0e6b4b393202'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:27.852277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] The token cache is being invalidate because project a3af70fed3384af6a03e00ad3f28b8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:16:27.858503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:27.858503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e874fba2-e783-4124-ae29-0e6b4b393202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:16:27.858503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 755/1509] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:16:27 2022] DELETE /identity/v3/projects/a3af70fed3384af6a03e00ad3f28b8ca => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:18:06.047585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf58fc-22f5-4802-b889-dddc985bfd95 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:06.048203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf58fc-22f5-4802-b889-dddc985bfd95 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:06.048203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf58fc-22f5-4802-b889-dddc985bfd95 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:06.049968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 755/1510] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:06.054788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951380f9-1b8d-4277-9d4b-e0a4ffcb53d3 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:06.055205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951380f9-1b8d-4277-9d4b-e0a4ffcb53d3 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:06.055351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951380f9-1b8d-4277-9d4b-e0a4ffcb53d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:06.074163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-951380f9-1b8d-4277-9d4b-e0a4ffcb53d3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:06.075364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-951380f9-1b8d-4277-9d4b-e0a4ffcb53d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:06.134225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 756/1511] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:06.289030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf58fc-22f5-4802-b889-dddc985bfd95 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:06.290706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-64cf58fc-22f5-4802-b889-dddc985bfd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:06.363830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf58fc-22f5-4802-b889-dddc985bfd95 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:06.369190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292a463-a94e-4aed-b0bc-f048db83e535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:06.369842 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a463-a94e-4aed-b0bc-f048db83e535 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:06.370127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a463-a94e-4aed-b0bc-f048db83e535 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:06.370406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292a463-a94e-4aed-b0bc-f048db83e535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:06.378461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292a463-a94e-4aed-b0bc-f048db83e535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:06.380048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292a463-a94e-4aed-b0bc-f048db83e535 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:06.389225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 756/1512] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:07.114671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00bd0-4f99-4731-8012-43519808bbe4 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:07.115269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00bd0-4f99-4731-8012-43519808bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:07.115269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00bd0-4f99-4731-8012-43519808bbe4 None None] PATH_INFO: `/v3` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:07.116535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 757/1513] 10.222.0.45 () {54 vars in 925 bytes} [Wed Feb 16 18:18:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:18:07.122801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80fc08-f3e8-4d62-b9de-b2a8ea22f1ff None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:07.123267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80fc08-f3e8-4d62-b9de-b2a8ea22f1ff None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:07.123374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80fc08-f3e8-4d62-b9de-b2a8ea22f1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:07.143344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7a80fc08-f3e8-4d62-b9de-b2a8ea22f1ff None None] MFA Rules not processed for user `6b08679e2a634bf08a279b6d8a9ffc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:07.144552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7a80fc08-f3e8-4d62-b9de-b2a8ea22f1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:07.211319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 757/1514] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Feb 16 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:07.735074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5adbf7-5ed1-4150-9077-9c4b1fa6b3f5 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:07.735370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5adbf7-5ed1-4150-9077-9c4b1fa6b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:07.735708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5adbf7-5ed1-4150-9077-9c4b1fa6b3f5 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:07.737552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 758/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:18:07.742637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60751051-ec57-41fe-94ef-57c87c2db97b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:07.742913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60751051-ec57-41fe-94ef-57c87c2db97b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:07.743193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60751051-ec57-41fe-94ef-57c87c2db97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:07.761541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-60751051-ec57-41fe-94ef-57c87c2db97b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:07.762742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-60751051-ec57-41fe-94ef-57c87c2db97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:07.771395 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 758/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:07.923710 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5adbf7-5ed1-4150-9077-9c4b1fa6b3f5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:07.942441 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5adbf7-5ed1-4150-9077-9c4b1fa6b3f5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:07.948122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6462443-3410-452e-86c9-c3d1ccafd203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:07.948766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6462443-3410-452e-86c9-c3d1ccafd203 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:07.949047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6462443-3410-452e-86c9-c3d1ccafd203 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:07.949419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6462443-3410-452e-86c9-c3d1ccafd203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:07.964088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6462443-3410-452e-86c9-c3d1ccafd203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:07.965749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6462443-3410-452e-86c9-c3d1ccafd203 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:07.976128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 759/1517] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:11.651783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932bcd6-4f03-4183-bb78-e2bf9308074e None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:11.652326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932bcd6-4f03-4183-bb78-e2bf9308074e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:11.652326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932bcd6-4f03-4183-bb78-e2bf9308074e None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:11.654155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 759/1518] 10.222.0.87 () {54 vars in 960 bytes} [Wed Feb 16 18:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:11.660766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c89358-f406-467f-adb6-07ad3abdbc99 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:11.661238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c89358-f406-467f-adb6-07ad3abdbc99 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:11.661376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c89358-f406-467f-adb6-07ad3abdbc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:11.681687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-26c89358-f406-467f-adb6-07ad3abdbc99 None None] MFA Rules not processed for user `6b08679e2a634bf08a279b6d8a9ffc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:11.682954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-26c89358-f406-467f-adb6-07ad3abdbc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:11.692170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 760/1519] 10.222.0.87 () {58 vars in 1057 bytes} [Wed Feb 16 18:18:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:11.704672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932bcd6-4f03-4183-bb78-e2bf9308074e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:11.720511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932bcd6-4f03-4183-bb78-e2bf9308074e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:11.725762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0c31-804a-42da-ba36-8d393b07fef1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:11.726463 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0c31-804a-42da-ba36-8d393b07fef1 service placement] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:11.726751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0c31-804a-42da-ba36-8d393b07fef1 service placement] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:11.727049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0c31-804a-42da-ba36-8d393b07fef1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:11.736889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0c31-804a-42da-ba36-8d393b07fef1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:11.738709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0c31-804a-42da-ba36-8d393b07fef1 service placement] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:11.751516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 760/1520] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:19.717616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceec17-b388-4855-9da0-578c6168f3d0 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:19.718221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceec17-b388-4855-9da0-578c6168f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:19.718221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceec17-b388-4855-9da0-578c6168f3d0 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:19.720051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 761/1521] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:19.725301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d63b-df42-4c9b-b8d0-8d0c0822d995 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:19.725771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d63b-df42-4c9b-b8d0-8d0c0822d995 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:19.725873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8d63b-df42-4c9b-b8d0-8d0c0822d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:19.744228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-21d8d63b-df42-4c9b-b8d0-8d0c0822d995 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:19.745461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-21d8d63b-df42-4c9b-b8d0-8d0c0822d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:19.754247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 761/1522] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:19.909854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ceec17-b388-4855-9da0-578c6168f3d0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:19.924817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ceec17-b388-4855-9da0-578c6168f3d0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:19.930221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed8e6b-a7d5-4478-ac64-15f79143e0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:19.930857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed8e6b-a7d5-4478-ac64-15f79143e0c5 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:19.931143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed8e6b-a7d5-4478-ac64-15f79143e0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:19.931419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed8e6b-a7d5-4478-ac64-15f79143e0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:19.940137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed8e6b-a7d5-4478-ac64-15f79143e0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:19.941782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed8e6b-a7d5-4478-ac64-15f79143e0c5 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:19.951390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 762/1523] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:21.254569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356987a-f01c-42e3-bd80-8617a26d6f75 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:21.255140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356987a-f01c-42e3-bd80-8617a26d6f75 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:21.255140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356987a-f01c-42e3-bd80-8617a26d6f75 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:21.256929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 762/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 18:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:21.264263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3a7b-549b-4635-919b-efbe1f35b234 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:21.264734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3a7b-549b-4635-919b-efbe1f35b234 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:21.265585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3a7b-549b-4635-919b-efbe1f35b234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:21.287364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e8db3a7b-549b-4635-919b-efbe1f35b234 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:21.288576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e8db3a7b-549b-4635-919b-efbe1f35b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:21.296399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 763/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:21.450188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356987a-f01c-42e3-bd80-8617a26d6f75 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:21.466292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356987a-f01c-42e3-bd80-8617a26d6f75 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:21.473066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88dc54-22df-4e86-b10f-d32ca1e80987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:21.473754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dc54-22df-4e86-b10f-d32ca1e80987 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:21.474040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dc54-22df-4e86-b10f-d32ca1e80987 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:21.474320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dc54-22df-4e86-b10f-d32ca1e80987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:21.483076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88dc54-22df-4e86-b10f-d32ca1e80987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:21.485200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88dc54-22df-4e86-b10f-d32ca1e80987 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:21.497179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 763/1526] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:25.948906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03024e-9921-41ba-b175-d1cdee13da00 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:25.949519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03024e-9921-41ba-b175-d1cdee13da00 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:25.949519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03024e-9921-41ba-b175-d1cdee13da00 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:25.951378 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 764/1527] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:25.957552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bac88b-4307-4d94-bf15-e470a6662f35 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:25.958139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bac88b-4307-4d94-bf15-e470a6662f35 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:25.958139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bac88b-4307-4d94-bf15-e470a6662f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:25.976858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-73bac88b-4307-4d94-bf15-e470a6662f35 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:25.978091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-73bac88b-4307-4d94-bf15-e470a6662f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:25.988057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 764/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:26.026550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03024e-9921-41ba-b175-d1cdee13da00 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:26.028256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1e03024e-9921-41ba-b175-d1cdee13da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:26.089776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03024e-9921-41ba-b175-d1cdee13da00 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:26.093938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb8a98-abd9-495c-a61b-e3df5a5b917d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:26.094587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8a98-abd9-495c-a61b-e3df5a5b917d service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:26.094874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8a98-abd9-495c-a61b-e3df5a5b917d service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:26.095149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb8a98-abd9-495c-a61b-e3df5a5b917d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:26.104415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb8a98-abd9-495c-a61b-e3df5a5b917d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:26.105910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb8a98-abd9-495c-a61b-e3df5a5b917d service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:26.116285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 765/1529] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:28.448390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc255b27-8264-4bb1-834a-f55ca9342a73 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:28.448917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc255b27-8264-4bb1-834a-f55ca9342a73 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:28.448917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc255b27-8264-4bb1-834a-f55ca9342a73 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:28.450660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 765/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:28.457275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8aab3-826f-43c1-9f54-9bca0d132c09 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:28.457732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8aab3-826f-43c1-9f54-9bca0d132c09 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:28.457930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8aab3-826f-43c1-9f54-9bca0d132c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:28.476584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-33e8aab3-826f-43c1-9f54-9bca0d132c09 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:28.477834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-33e8aab3-826f-43c1-9f54-9bca0d132c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:28.486251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 766/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:28.522486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc255b27-8264-4bb1-834a-f55ca9342a73 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:28.534053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc255b27-8264-4bb1-834a-f55ca9342a73 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:28.537769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa1365-3e45-425d-afe1-1afc52b2c06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:28.538421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa1365-3e45-425d-afe1-1afc52b2c06a service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:28.538708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa1365-3e45-425d-afe1-1afc52b2c06a service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:28.538986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa1365-3e45-425d-afe1-1afc52b2c06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:28.548737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa1365-3e45-425d-afe1-1afc52b2c06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:28.550218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa1365-3e45-425d-afe1-1afc52b2c06a service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:28.559939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 766/1532] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:32.503054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744213-938f-40cb-8dd1-53b2b3f3a57d None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:32.503640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744213-938f-40cb-8dd1-53b2b3f3a57d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:32.503640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744213-938f-40cb-8dd1-53b2b3f3a57d None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:32.505461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 767/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:32.510744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56418-c6aa-47c4-a7c4-b779828d97fd None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:32.511167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56418-c6aa-47c4-a7c4-b779828d97fd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:32.511301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b56418-c6aa-47c4-a7c4-b779828d97fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:32.530075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e1b56418-c6aa-47c4-a7c4-b779828d97fd None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:32.531762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e1b56418-c6aa-47c4-a7c4-b779828d97fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:32.539710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 767/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:32.797528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744213-938f-40cb-8dd1-53b2b3f3a57d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:32.799144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-68744213-938f-40cb-8dd1-53b2b3f3a57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:32.858823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744213-938f-40cb-8dd1-53b2b3f3a57d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:32.862821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4221b-1b91-4e14-8f4d-d89faa6f21bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:32.863468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4221b-1b91-4e14-8f4d-d89faa6f21bd service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:32.863748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4221b-1b91-4e14-8f4d-d89faa6f21bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:32.864019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4221b-1b91-4e14-8f4d-d89faa6f21bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:32.873816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4221b-1b91-4e14-8f4d-d89faa6f21bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:32.875999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4221b-1b91-4e14-8f4d-d89faa6f21bd service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:32.886074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 768/1535] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:18:35.329589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ba33-9968-4911-b1a1-2c647ad1bece None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:35.330166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ba33-9968-4911-b1a1-2c647ad1bece None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:35.330166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ba33-9968-4911-b1a1-2c647ad1bece None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:35.331923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 768/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 18:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:35.337722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f4b4-2624-413b-a371-aa23b7f1bdfd None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:35.338226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f4b4-2624-413b-a371-aa23b7f1bdfd None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:35.338408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65f4b4-2624-413b-a371-aa23b7f1bdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:35.356921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7d65f4b4-2624-413b-a371-aa23b7f1bdfd None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:35.358159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7d65f4b4-2624-413b-a371-aa23b7f1bdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:35.368131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 769/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:35.630161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8614c-a787-4daf-a7cf-cfa8d8f0dab0 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:35.630447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8614c-a787-4daf-a7cf-cfa8d8f0dab0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:35.630753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8614c-a787-4daf-a7cf-cfa8d8f0dab0 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:35.632560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 769/1538] 10.222.0.87 () {54 vars in 963 bytes} [Wed Feb 16 18:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:18:35.638369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359dbf3-c6f8-4d31-ada7-bc6def799836 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:35.638951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359dbf3-c6f8-4d31-ada7-bc6def799836 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:35.639331 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359dbf3-c6f8-4d31-ada7-bc6def799836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:35.659196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0359dbf3-c6f8-4d31-ada7-bc6def799836 None None] MFA Rules not processed for user `829b4ad50f8441248c0b6d5259b89fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:18:35.660452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0359dbf3-c6f8-4d31-ada7-bc6def799836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:18:35.667093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 770/1539] 10.222.0.87 () {58 vars in 1060 bytes} [Wed Feb 16 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:18:35.675583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8614c-a787-4daf-a7cf-cfa8d8f0dab0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:18:35.686364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8614c-a787-4daf-a7cf-cfa8d8f0dab0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:18:35.691102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c305-6db3-4696-944e-b0b192be0126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:18:35.691758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c305-6db3-4696-944e-b0b192be0126 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:18:35.692042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c305-6db3-4696-944e-b0b192be0126 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:18:35.692323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c305-6db3-4696-944e-b0b192be0126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:18:35.702258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c305-6db3-4696-944e-b0b192be0126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:18:35.703854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c305-6db3-4696-944e-b0b192be0126 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:18:35.714072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 770/1540] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:20:03.159509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6eab-a0fd-4632-9eba-6b6249f6b533 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.160546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6eab-a0fd-4632-9eba-6b6249f6b533 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.160546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf6eab-a0fd-4632-9eba-6b6249f6b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.221768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-60cf6eab-a0fd-4632-9eba-6b6249f6b533 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.223788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-60cf6eab-a0fd-4632-9eba-6b6249f6b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.245747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 771/1541] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.260051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afdfb-f042-46c0-a811-e0d6519a30bd None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.261211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afdfb-f042-46c0-a811-e0d6519a30bd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.261774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afdfb-f042-46c0-a811-e0d6519a30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.289917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-301afdfb-f042-46c0-a811-e0d6519a30bd None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.291512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-301afdfb-f042-46c0-a811-e0d6519a30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.306755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 771/1542] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.314725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6eab-a0fd-4632-9eba-6b6249f6b533 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:03.328531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf6eab-a0fd-4632-9eba-6b6249f6b533 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:03.342004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aed406-09c0-4d72-9231-5519e2089b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:03.343516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed406-09c0-4d72-9231-5519e2089b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.343804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed406-09c0-4d72-9231-5519e2089b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.344083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed406-09c0-4d72-9231-5519e2089b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.345471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aed406-09c0-4d72-9231-5519e2089b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:03.345843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aed406-09c0-4d72-9231-5519e2089b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:03.347722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aed406-09c0-4d72-9231-5519e2089b02 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:03.363912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 772/1543] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:03.374986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301afdfb-f042-46c0-a811-e0d6519a30bd None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:03.390735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301afdfb-f042-46c0-a811-e0d6519a30bd None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:03.400393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a240-080a-4bf6-90d3-f90709c52cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:03.401501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a240-080a-4bf6-90d3-f90709c52cda admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.402011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a240-080a-4bf6-90d3-f90709c52cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.402518 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a240-080a-4bf6-90d3-f90709c52cda admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.403454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a240-080a-4bf6-90d3-f90709c52cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:03.406136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a240-080a-4bf6-90d3-f90709c52cda admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:03.466940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf2a2-8670-4e5e-9f02-a0f84860c3e8 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.467305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf2a2-8670-4e5e-9f02-a0f84860c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.467495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf2a2-8670-4e5e-9f02-a0f84860c3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.501428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-556bf2a2-8670-4e5e-9f02-a0f84860c3e8 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.502933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-556bf2a2-8670-4e5e-9f02-a0f84860c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.515876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 773/1544] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:03.517423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c28c3-e090-4307-b2ad-b734bb958294 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.517781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c28c3-e090-4307-b2ad-b734bb958294 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.518122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c28c3-e090-4307-b2ad-b734bb958294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.547583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ce7c28c3-e090-4307-b2ad-b734bb958294 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.553732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ce7c28c3-e090-4307-b2ad-b734bb958294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.562013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 772/1545] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:03.564616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a02f9-fa9e-4474-ad49-6649ddff6f54 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.565204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a02f9-fa9e-4474-ad49-6649ddff6f54 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.565719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a02f9-fa9e-4474-ad49-6649ddff6f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.570589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 774/1546] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.573106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c28c3-e090-4307-b2ad-b734bb958294 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:03.584648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c28c3-e090-4307-b2ad-b734bb958294 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:03.610164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f75a02f9-fa9e-4474-ad49-6649ddff6f54 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.611902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f75a02f9-fa9e-4474-ad49-6649ddff6f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.659824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7890f26-b3b4-4c23-85e7-6e09d9f5f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:03.660519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890f26-b3b4-4c23-85e7-6e09d9f5f785 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.660808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890f26-b3b4-4c23-85e7-6e09d9f5f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.661102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890f26-b3b4-4c23-85e7-6e09d9f5f785 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.661814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7890f26-b3b4-4c23-85e7-6e09d9f5f785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:03.663778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7890f26-b3b4-4c23-85e7-6e09d9f5f785 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:03.711719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 773/1547] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.712769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459beb9-b784-4ce2-ba18-d78b62e46be5 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.713057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459beb9-b784-4ce2-ba18-d78b62e46be5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.717171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459beb9-b784-4ce2-ba18-d78b62e46be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.739432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b459beb9-b784-4ce2-ba18-d78b62e46be5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.740654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b459beb9-b784-4ce2-ba18-d78b62e46be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.749390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 774/1548] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.750956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66784-f230-430f-9048-54abea156f40 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.757639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66784-f230-430f-9048-54abea156f40 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.757639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66784-f230-430f-9048-54abea156f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.774404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 775/1549] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:20:03.778325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc25d0e-c84b-4984-a098-42cbbaf55d75 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.778325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc25d0e-c84b-4984-a098-42cbbaf55d75 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.778325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc25d0e-c84b-4984-a098-42cbbaf55d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.787823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-32a66784-f230-430f-9048-54abea156f40 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.792018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-32a66784-f230-430f-9048-54abea156f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.805277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-adc25d0e-c84b-4984-a098-42cbbaf55d75 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.806522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-adc25d0e-c84b-4984-a098-42cbbaf55d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.811430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 775/1550] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.813583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457bfc-9049-4349-92b0-aedb72e8e9f7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.815192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457bfc-9049-4349-92b0-aedb72e8e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.815695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94457bfc-9049-4349-92b0-aedb72e8e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.821463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 776/1551] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.822671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc25d0e-c84b-4984-a098-42cbbaf55d75 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:03.838718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc25d0e-c84b-4984-a098-42cbbaf55d75 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:03.843134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-94457bfc-9049-4349-92b0-aedb72e8e9f7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.844122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:03.845160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.845511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.845868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.846206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-94457bfc-9049-4349-92b0-aedb72e8e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.846738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:03.847115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:03.848904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:03.864595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 776/1552] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.865471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457bfc-9049-4349-92b0-aedb72e8e9f7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:03.867668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 777/1553] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:03.868821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:03.875765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94457bfc-9049-4349-92b0-aedb72e8e9f7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:03.881648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd36d8b-3720-4545-b917-361f18993e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:03.882592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36d8b-3720-4545-b917-361f18993e09 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.882869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36d8b-3720-4545-b917-361f18993e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.883141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd36d8b-3720-4545-b917-361f18993e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.883911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd36d8b-3720-4545-b917-361f18993e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:03.884320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd36d8b-3720-4545-b917-361f18993e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:03.885973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd36d8b-3720-4545-b917-361f18993e09 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:03.887444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf8f61-acc7-4882-9136-14505c18fb8d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:03.894663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7961-d2a0-4758-ab8a-e996f95ed218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:03.896247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7961-d2a0-4758-ab8a-e996f95ed218 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.896779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7961-d2a0-4758-ab8a-e996f95ed218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.897310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7961-d2a0-4758-ab8a-e996f95ed218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.898857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7961-d2a0-4758-ab8a-e996f95ed218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:03.901098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7961-d2a0-4758-ab8a-e996f95ed218 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:03.901431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 777/1554] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:03.909377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ad45-a639-400c-88a7-422952f6b2b7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.909377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ad45-a639-400c-88a7-422952f6b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.909377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1ad45-a639-400c-88a7-422952f6b2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.921248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 778/1555] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:03.922874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c848b-7a4d-4cbb-ad69-45833579c55d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.923878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c848b-7a4d-4cbb-ad69-45833579c55d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.924347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c848b-7a4d-4cbb-ad69-45833579c55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.931948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-20d1ad45-a639-400c-88a7-422952f6b2b7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.933196 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-20d1ad45-a639-400c-88a7-422952f6b2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.942363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 778/1556] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.943145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ad45-a639-400c-88a7-422952f6b2b7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:03.946983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a20c848b-7a4d-4cbb-ad69-45833579c55d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.948645 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a20c848b-7a4d-4cbb-ad69-45833579c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.953492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1ad45-a639-400c-88a7-422952f6b2b7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:03.959201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:03.960022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 779/1557] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.960283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.961053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.961424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.962233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:03.964624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:03.965554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8101-b169-4e41-b48f-48c222f92149 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:03.965850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8101-b169-4e41-b48f-48c222f92149 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:03.966151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de8101-b169-4e41-b48f-48c222f92149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:03.987969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c3de8101-b169-4e41-b48f-48c222f92149 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:03.989324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c3de8101-b169-4e41-b48f-48c222f92149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:03.997933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 780/1558] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:03.999950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156236-4dc5-4f16-b2f5-a61317dcea2d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.000273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156236-4dc5-4f16-b2f5-a61317dcea2d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.000718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156236-4dc5-4f16-b2f5-a61317dcea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.022900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9f156236-4dc5-4f16-b2f5-a61317dcea2d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:04.024147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9f156236-4dc5-4f16-b2f5-a61317dcea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:04.033598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 781/1559] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:04.034169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f156236-4dc5-4f16-b2f5-a61317dcea2d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.039549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 779/1560] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:03 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:04.040935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.046380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f156236-4dc5-4f16-b2f5-a61317dcea2d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.107616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.108284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.108569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.108845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.109653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.111986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64b9d-1ffd-4884-91f5-13410a4e2d99 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.112151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.116691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.117389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.117674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.117951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.118680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.120248 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.130543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 780/1561] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:04.131378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.141225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2ae78-d68e-44e3-8c7f-d2467aedf764 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.146345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.146987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.147273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.147552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.148260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:04.148564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.150160 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.163515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 781/1562] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:04.170343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.174966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea9958-43c3-42d2-ab70-564d407aa89d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.179638 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.180283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.180566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.180847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.181590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:04.181946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.183459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.196265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 782/1563] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:04.200358 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.207184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ccf9-bd5c-4d2f-b884-0c8bd0a1045f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.211873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bdebe-db4a-420a-8d0a-5b5402bd95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.212524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 782/1564] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:04.213009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bdebe-db4a-420a-8d0a-5b5402bd95d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.213009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bdebe-db4a-420a-8d0a-5b5402bd95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.213329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bdebe-db4a-420a-8d0a-5b5402bd95d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.213414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.213801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bdebe-db4a-420a-8d0a-5b5402bd95d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:04.214155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bdebe-db4a-420a-8d0a-5b5402bd95d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.215732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bdebe-db4a-420a-8d0a-5b5402bd95d0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.229072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 783/1565] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:04.230410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0f5e5-73b7-4227-ac0e-88c48c2249f5 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.230694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0f5e5-73b7-4227-ac0e-88c48c2249f5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.230980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0f5e5-73b7-4227-ac0e-88c48c2249f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.252759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-00e0f5e5-73b7-4227-ac0e-88c48c2249f5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:04.254009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-00e0f5e5-73b7-4227-ac0e-88c48c2249f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:04.280687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83675-b37f-4688-a24c-1b05b6d52d6b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.286565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.287238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.287521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.287800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.288493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.290467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.312176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 784/1566] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:04.314093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2acb9e-b420-49e5-be5a-a5565e2aa87f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.314377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2acb9e-b420-49e5-be5a-a5565e2aa87f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.314787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2acb9e-b420-49e5-be5a-a5565e2aa87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.333318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4f2acb9e-b420-49e5-be5a-a5565e2aa87f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:04.334528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4f2acb9e-b420-49e5-be5a-a5565e2aa87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:04.347677 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 785/1567] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:04.348505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2acb9e-b420-49e5-be5a-a5565e2aa87f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.358712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2acb9e-b420-49e5-be5a-a5565e2aa87f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.365000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.365912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.366222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.366499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] PATH_INFO: `/v3/projects/2718f4cc73ec4c7f8eca8f0c81e8ca36/users/c07c36b66f8443378c775a1963be4574/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.382003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2718f4cc73ec4c7f8eca8f0c81e8ca36, user_id=c07c36b66f8443378c775a1963be4574, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.384663 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.398035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 783/1568] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:04.398851 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.409288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6696d6-83f0-4ee4-8ba1-bac66e6b72b8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.414210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.414861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.415170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.415446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.416141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.418087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.478736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 786/1569] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:04 2022] PUT /identity/v3/projects/2718f4cc73ec4c7f8eca8f0c81e8ca36/users/c07c36b66f8443378c775a1963be4574/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:04.478736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.508960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 784/1570] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:04.510154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.544897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6ca7f-3a74-44ff-a76e-63a4d88ea860 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.575513 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2f9ac-67ad-4116-a9b4-bf09e8e40c46 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.580549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.581534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.581817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.582093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.582783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.584719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.600695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.601401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.601688 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.601973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.602661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.604606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.711457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 785/1571] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:04.712272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.721840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720df3f7-74f5-4098-ba59-cf9c43c6d4a7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.726427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53a9d9-cb1e-48d4-81a3-4d797bef77ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.732208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a9d9-cb1e-48d4-81a3-4d797bef77ed admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.732208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a9d9-cb1e-48d4-81a3-4d797bef77ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.732208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53a9d9-cb1e-48d4-81a3-4d797bef77ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.732208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53a9d9-cb1e-48d4-81a3-4d797bef77ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.732208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53a9d9-cb1e-48d4-81a3-4d797bef77ed admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.758568 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 787/1572] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:04.760761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.818336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094893-bfb2-43e6-ab3e-c2b11ab5d816 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.822993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.823655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.823942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.824483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.825268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:04.825578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.830267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 786/1573] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:04.830267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ba00f-b856-4c8c-a8d1-ccc955125596 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.830552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.830647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ba00f-b856-4c8c-a8d1-ccc955125596 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.830647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ba00f-b856-4c8c-a8d1-ccc955125596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.841693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 788/1574] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:04.852701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.852701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aa2c1-d6e7-4099-8f3b-614ec56077ff admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.854518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7e3ba00f-b856-4c8c-a8d1-ccc955125596 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:04.855727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7e3ba00f-b856-4c8c-a8d1-ccc955125596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:04.910212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.910917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.911198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.911471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.912224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.913843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.916797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 787/1575] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:04.918136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c288-e49e-4413-9877-961dfb6f5eee None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.918427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c288-e49e-4413-9877-961dfb6f5eee None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.919068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c288-e49e-4413-9877-961dfb6f5eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.925112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 789/1576] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:04.926570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:04.935756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437404ac-fc26-4590-963b-aa06ca199dd9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:04.941150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:04.941826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:04.942110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:04.942386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:04.943079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:04.944978 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:04.945778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c0b1c288-e49e-4413-9877-961dfb6f5eee None None] MFA Rules not processed for user `c07c36b66f8443378c775a1963be4574`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:04.946973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c0b1c288-e49e-4413-9877-961dfb6f5eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:05.012927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 788/1577] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:05.013733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1c288-e49e-4413-9877-961dfb6f5eee None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.023638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1c288-e49e-4413-9877-961dfb6f5eee None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.030070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.030070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.030070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.030070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.030451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.031635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.042493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 789/1578] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.043259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.053619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6af95-ee14-4ba1-b437-f8e532a93f3a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.055421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 790/1579] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:04 2022] POST /identity/v3/users => generated 283 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:05.056340 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.059924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.060862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.061176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.061455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.062147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.064194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.067151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb23e-4e5c-496c-baba-d2d9791ac9f6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.072004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.072671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.072953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.073579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.073943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.076318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.139739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 790/1580] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:05.140565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.150421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14b8f-e3b5-4868-81cc-8ba4dbe753c4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.155003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.155637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.155917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.156203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.156882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.159501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.213811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 791/1581] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:05.214656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.225200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5133-ffec-4485-8413-eca36f5c1dca admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.229787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.230445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.230738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.231002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.231717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:05.232024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.233651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.242603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 791/1582] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:05.242603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.256330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 792/1583] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:05.256330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.259037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5fb24-7508-4182-9f8a-44884856368e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.305752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd5fe8-81c9-4391-abfe-3213476c180f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.310363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.311031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.311319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.311597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.312384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.314626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.316668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.317363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.317651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.318054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.318747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.320636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.324693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 792/1584] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.325545 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.336152 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9643a-f460-4a98-9c07-7870dc37368b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.341181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.341873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.342164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.342457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.343170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.344825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.355449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 793/1585] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.356249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.366003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981d97e-ff63-43c8-841a-c7aa341c39c5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.370856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.371516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.371806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.372111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.372896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.374603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.385241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 794/1586] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.390738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.396183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cec95-2645-41da-abd6-8a0149e1a848 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.400799 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.401478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.401763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.402080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.402790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.404359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.414873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 795/1587] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.416675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.425480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e454d-97d9-429d-99f3-70ce4db9fe1d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.430056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.430687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.430970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.431247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.431950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.433545 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.444007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 796/1588] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.447577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 793/1589] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:05.447730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.447837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.458174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d39b2-d214-4dc8-81e5-33e162087ab4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.510346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790098f-c628-479e-85c4-7fe20791128f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.515220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.515952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.516238 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.516514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.517995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.519456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.520055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.520223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.520404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.520749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.521453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.523357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.625543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 797/1590] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:05.626684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.636106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179d46-5864-4443-9e2b-600bbb53e51d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.641065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.642534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.642818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.643124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] PATH_INFO: `/v3/projects/e505f411abb9430fb6dc82bf7c802903/users/a3c5aec16fa247608455d563967032a0/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.651065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 794/1591] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:05.654573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.662874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e505f411abb9430fb6dc82bf7c802903, user_id=a3c5aec16fa247608455d563967032a0, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.666395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.719715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c43dd-554f-49ef-b115-372c2080454d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.724601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.725582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.725848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.726116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] PATH_INFO: `/v3/projects/efbdb7c40fd94d5498cfb15faf9f047b/users/4d489f11dc814054973894e02f6b681b/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.740900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdb7c40fd94d5498cfb15faf9f047b, user_id=4d489f11dc814054973894e02f6b681b, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.743773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.790995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 798/1592] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:05 2022] PUT /identity/v3/projects/e505f411abb9430fb6dc82bf7c802903/users/a3c5aec16fa247608455d563967032a0/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:05.792136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.832512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 795/1593] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:05 2022] PUT /identity/v3/projects/efbdb7c40fd94d5498cfb15faf9f047b/users/4d489f11dc814054973894e02f6b681b/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:05.833463 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.855245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5cfe3-1558-4e6b-b226-bb584a520711 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.895341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b667cd0-bc01-485d-8043-260099e8fd29 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.899936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.900609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.900883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.901188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.901906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.903489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.911290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.911960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.912241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.912515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.913410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.914080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 796/1594] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.917440 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.917568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.924181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f1554-bdea-4fbd-b223-3f58d5a3a3b7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.930824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 799/1595] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.930824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.931212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.931212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.931212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.931212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.931859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.932724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.940603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716fa7-b667-4ef1-80c7-b2c937760413 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.943993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 797/1596] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.944835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.948770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746be2c6-fc80-4039-b58a-a19ac8bb6f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.949812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746be2c6-fc80-4039-b58a-a19ac8bb6f8f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.950029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746be2c6-fc80-4039-b58a-a19ac8bb6f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.950280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746be2c6-fc80-4039-b58a-a19ac8bb6f8f admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.950967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746be2c6-fc80-4039-b58a-a19ac8bb6f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.952878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746be2c6-fc80-4039-b58a-a19ac8bb6f8f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.957253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf8e45-e40b-49a5-8094-0b7d2099ce5a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.961858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.962531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.962812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.963468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.963811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.965522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:05.976289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 798/1597] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:05.979972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:05.987200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcb423-2a56-4dde-9294-b2903e7fc854 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:05.991852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e880986-6ea7-4921-ac41-6509fa9a194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:05.992502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880986-6ea7-4921-ac41-6509fa9a194c admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:05.992783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880986-6ea7-4921-ac41-6509fa9a194c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:05.993058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880986-6ea7-4921-ac41-6509fa9a194c admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:05.993765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e880986-6ea7-4921-ac41-6509fa9a194c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:05.996367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e880986-6ea7-4921-ac41-6509fa9a194c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.054691 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 800/1598] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:06.056155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac6c83-d6de-48c6-ab64-f860d2b8e370 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.056576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac6c83-d6de-48c6-ab64-f860d2b8e370 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.056869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac6c83-d6de-48c6-ab64-f860d2b8e370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.075337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-11ac6c83-d6de-48c6-ab64-f860d2b8e370 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:06.076622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-11ac6c83-d6de-48c6-ab64-f860d2b8e370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:06.077851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 799/1599] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:05 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:06.082433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcee0-c151-47e6-9722-ea261ec4d578 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.082778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcee0-c151-47e6-9722-ea261ec4d578 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.083020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcee0-c151-47e6-9722-ea261ec4d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.085127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 801/1600] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:06.085931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac6c83-d6de-48c6-ab64-f860d2b8e370 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.095378 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac6c83-d6de-48c6-ab64-f860d2b8e370 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.100268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.101219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.106778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.106778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] PATH_INFO: `/v3/projects/0aaf8bb86aa245d6a791ffe04f8a7cea/users/9463920d27f94ad688f3850e88795c5b/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.110089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-988fcee0-c151-47e6-9722-ea261ec4d578 None None] MFA Rules not processed for user `4d489f11dc814054973894e02f6b681b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:06.111908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-988fcee0-c151-47e6-9722-ea261ec4d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:06.117709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aaf8bb86aa245d6a791ffe04f8a7cea, user_id=9463920d27f94ad688f3850e88795c5b, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.120404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.177033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 800/1601] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:06.177904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcee0-c151-47e6-9722-ea261ec4d578 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.190234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcee0-c151-47e6-9722-ea261ec4d578 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.191509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 802/1602] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:06 2022] PUT /identity/v3/projects/0aaf8bb86aa245d6a791ffe04f8a7cea/users/9463920d27f94ad688f3850e88795c5b/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:06.193776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.253554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.254455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.254731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.255002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] PATH_INFO: `/v3/projects/ba56aa01fe9742c88c5ce8ff243dbe69/users/48afc15bf0414686ac03d34a90f1f00f/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.256524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d54e1a-b5bd-42eb-90f7-489cb1d5d984 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.261185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.262075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.262361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.262638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] PATH_INFO: `/v3/projects/69b35d149a88415aa4b03267e9472c81/users/a8eb096cf2c04b4db0ed9c7f71beae9e/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.269195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba56aa01fe9742c88c5ce8ff243dbe69, user_id=48afc15bf0414686ac03d34a90f1f00f, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.271866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.277287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b35d149a88415aa4b03267e9472c81, user_id=a8eb096cf2c04b4db0ed9c7f71beae9e, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.280028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.356347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 801/1603] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:06 2022] PUT /identity/v3/projects/ba56aa01fe9742c88c5ce8ff243dbe69/users/48afc15bf0414686ac03d34a90f1f00f/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:06.357120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.384966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 803/1604] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:06 2022] PUT /identity/v3/projects/69b35d149a88415aa4b03267e9472c81/users/a8eb096cf2c04b4db0ed9c7f71beae9e/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:06.388048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.423695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87ad05-c216-4f99-aa4c-1cc3e2d05f18 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.448162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce7997-8d5b-4e5d-82ca-65442f64e4e6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.452984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.453683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.453966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.454362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.455268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.456891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.467018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 804/1605] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:06.467935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.478300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50520c-54dd-4662-9cf0-2c6c5755fb68 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.480592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.481339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.481627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.481907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.482737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.483038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942863a8-4c75-443f-8828-6c6818d92b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.483771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942863a8-4c75-443f-8828-6c6818d92b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.484054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942863a8-4c75-443f-8828-6c6818d92b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.484334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942863a8-4c75-443f-8828-6c6818d92b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.484451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.485056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942863a8-4c75-443f-8828-6c6818d92b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.487317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942863a8-4c75-443f-8828-6c6818d92b0d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.496087 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 802/1606] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:06.496839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.500360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 805/1607] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:06.500360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514851bf-61a4-4f99-80be-36e93782dda4 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.500360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514851bf-61a4-4f99-80be-36e93782dda4 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.500360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514851bf-61a4-4f99-80be-36e93782dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.500765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:06.517241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-514851bf-61a4-4f99-80be-36e93782dda4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:06.518455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-514851bf-61a4-4f99-80be-36e93782dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:06.526231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 806/1608] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:06.527730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fdf6-6fcd-482b-a6e6-a585026e0fb9 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.528130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fdf6-6fcd-482b-a6e6-a585026e0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.528510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307fdf6-6fcd-482b-a6e6-a585026e0fb9 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.530524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 807/1609] 10.222.0.87 () {54 vars in 961 bytes} [Wed Feb 16 18:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:20:06.531677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3498-b91b-448f-b5fb-13cd6dd0e587 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.532042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3498-b91b-448f-b5fb-13cd6dd0e587 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.532990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3498-b91b-448f-b5fb-13cd6dd0e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.559104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc597-5e9b-433d-b5c6-b2696a1f0c56 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.559794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b81f3498-b91b-448f-b5fb-13cd6dd0e587 None None] MFA Rules not processed for user `48afc15bf0414686ac03d34a90f1f00f`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:06.561001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b81f3498-b91b-448f-b5fb-13cd6dd0e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:06.562975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edf48b-10de-40f9-a07b-53a26846fa5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.564332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf48b-10de-40f9-a07b-53a26846fa5b service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.564460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf48b-10de-40f9-a07b-53a26846fa5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.564664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf48b-10de-40f9-a07b-53a26846fa5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.573880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf48b-10de-40f9-a07b-53a26846fa5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.575542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf48b-10de-40f9-a07b-53a26846fa5b service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.585631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 803/1610] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:06.588016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264616f-d2cd-4ce3-b367-9a4a698ff7e1 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.588016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264616f-d2cd-4ce3-b367-9a4a698ff7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.588414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264616f-d2cd-4ce3-b367-9a4a698ff7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.622531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d264616f-d2cd-4ce3-b367-9a4a698ff7e1 None None] MFA Rules not processed for user `a8eb096cf2c04b4db0ed9c7f71beae9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:06.622531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d264616f-d2cd-4ce3-b367-9a4a698ff7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:06.631305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 808/1611] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:06.632221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3498-b91b-448f-b5fb-13cd6dd0e587 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.646582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3498-b91b-448f-b5fb-13cd6dd0e587 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.652000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.652701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.652989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.653288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.654014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.655722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.666116 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 809/1612] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:06.666948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.677905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfcdf6-a73f-457e-bc32-6254cd4f18e8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.682534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.683410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.683690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.683971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] PATH_INFO: `/v3/projects/339ea1b3310e461bb59b1473f0ad5b22/users/a31cad5460ee494c8af2b7f8f340905d/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.691733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 804/1613] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:06.692687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264616f-d2cd-4ce3-b367-9a4a698ff7e1 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.702012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339ea1b3310e461bb59b1473f0ad5b22, user_id=a31cad5460ee494c8af2b7f8f340905d, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.704878 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264616f-d2cd-4ce3-b367-9a4a698ff7e1 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.706038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.710747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02bb5d-5ad3-47e7-8671-57248aef07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.711257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02bb5d-5ad3-47e7-8671-57248aef07f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.711482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02bb5d-5ad3-47e7-8671-57248aef07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.711770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02bb5d-5ad3-47e7-8671-57248aef07f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.712592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02bb5d-5ad3-47e7-8671-57248aef07f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.714237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02bb5d-5ad3-47e7-8671-57248aef07f6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.725139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 805/1614] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:06.726232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731e8b-d9a5-4796-a6cb-2c38e696ee4b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.726523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731e8b-d9a5-4796-a6cb-2c38e696ee4b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.726803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731e8b-d9a5-4796-a6cb-2c38e696ee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.745299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-da731e8b-d9a5-4796-a6cb-2c38e696ee4b None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:06.746501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-da731e8b-d9a5-4796-a6cb-2c38e696ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:06.796873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 810/1615] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:06 2022] PUT /identity/v3/projects/339ea1b3310e461bb59b1473f0ad5b22/users/a31cad5460ee494c8af2b7f8f340905d/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:06.800700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.818339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 806/1616] 10.222.0.87 () {58 vars in 1058 bytes} [Wed Feb 16 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:06.818339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731e8b-d9a5-4796-a6cb-2c38e696ee4b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.858347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43032d4b-592e-40d5-9aff-0f5943d16d39 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.863383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.864101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.864398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.864677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.875499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731e8b-d9a5-4796-a6cb-2c38e696ee4b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.940850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.941678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.941958 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.942360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:06.962580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:06.964216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:06.975500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 811/1617] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:06.976158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:06.988456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e83b-d53d-4f21-877c-8ba7aa797ece service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:06.993864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:06.996599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:06.996599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:06.996599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] PATH_INFO: `/v3/projects/92d63ad9a87b454cb289a0b4c52b3e43/users/39ef7efc62d54fc1b5b9f140232e2095/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.008726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.010838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.015061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d63ad9a87b454cb289a0b4c52b3e43, user_id=39ef7efc62d54fc1b5b9f140232e2095, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.018489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.022425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 807/1618] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:07.024937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:07.036871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c9b26-4801-4e70-8ce8-a4b8188721fd service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:07.041609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66eea5-413d-491f-80d8-e5ea30b07ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:07.048517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66eea5-413d-491f-80d8-e5ea30b07ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.048517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66eea5-413d-491f-80d8-e5ea30b07ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.048517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66eea5-413d-491f-80d8-e5ea30b07ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.048517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66eea5-413d-491f-80d8-e5ea30b07ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.048517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66eea5-413d-491f-80d8-e5ea30b07ce3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.158469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 812/1619] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:06 2022] PUT /identity/v3/projects/92d63ad9a87b454cb289a0b4c52b3e43/users/39ef7efc62d54fc1b5b9f140232e2095/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:07.159706 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:07.166218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 808/1620] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:07 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:07.166218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426ef8-8f53-45a4-b9c4-84c64c33d050 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.166218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426ef8-8f53-45a4-b9c4-84c64c33d050 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.166218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426ef8-8f53-45a4-b9c4-84c64c33d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.242559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d2426ef8-8f53-45a4-b9c4-84c64c33d050 None None] MFA Rules not processed for user `a31cad5460ee494c8af2b7f8f340905d`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:07.244088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d2426ef8-8f53-45a4-b9c4-84c64c33d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:07.286298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f3efc-d478-475f-8759-7064d95aad57 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:07.372488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:07.372816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 809/1621] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:07.373422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.373701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2426ef8-8f53-45a4-b9c4-84c64c33d050 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:07.373831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.374264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] PATH_INFO: `/v3/projects/b362f8ebf3754634a11d802a8fb65752/users/c9b1f1ed2fe14f66a3c74642daf4aa3a/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.405468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b362f8ebf3754634a11d802a8fb65752, user_id=c9b1f1ed2fe14f66a3c74642daf4aa3a, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.409531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.465138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2426ef8-8f53-45a4-b9c4-84c64c33d050 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:07.476486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fe669-1bd6-47d8-aca0-033182682c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:07.477707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fe669-1bd6-47d8-aca0-033182682c80 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.478264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fe669-1bd6-47d8-aca0-033182682c80 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.478784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fe669-1bd6-47d8-aca0-033182682c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.490006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 813/1622] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:07 2022] PUT /identity/v3/projects/b362f8ebf3754634a11d802a8fb65752/users/c9b1f1ed2fe14f66a3c74642daf4aa3a/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:07.491146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:07.552133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fe669-1bd6-47d8-aca0-033182682c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.554045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fe669-1bd6-47d8-aca0-033182682c80 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.564505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 810/1623] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:07.566336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568e2c4-47b4-45a5-94d4-38a441049095 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.573632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568e2c4-47b4-45a5-94d4-38a441049095 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.574546 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568e2c4-47b4-45a5-94d4-38a441049095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.590434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6814c3-9385-4eaa-94e9-224f9f22b7f8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:07.614793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c4768-0dcc-4c41-8f9a-d4b6253c65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:07.615652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c4768-0dcc-4c41-8f9a-d4b6253c65a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.616269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c4768-0dcc-4c41-8f9a-d4b6253c65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.616525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c4768-0dcc-4c41-8f9a-d4b6253c65a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.617439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c4768-0dcc-4c41-8f9a-d4b6253c65a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.619349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c4768-0dcc-4c41-8f9a-d4b6253c65a5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.632245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-9568e2c4-47b4-45a5-94d4-38a441049095 None None] MFA Rules not processed for user `39ef7efc62d54fc1b5b9f140232e2095`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:07.634515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9568e2c4-47b4-45a5-94d4-38a441049095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:07.757234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 814/1624] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:07 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:07.758930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bb9a1-3f32-4e81-a51c-7b2e003046f3 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.759382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bb9a1-3f32-4e81-a51c-7b2e003046f3 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.759822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bb9a1-3f32-4e81-a51c-7b2e003046f3 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.768013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 815/1625] 10.222.0.87 () {54 vars in 961 bytes} [Wed Feb 16 18:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:20:07.768013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234b50-12e2-4dbe-a39c-226d182a7ebf None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.772179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234b50-12e2-4dbe-a39c-226d182a7ebf None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.772728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234b50-12e2-4dbe-a39c-226d182a7ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.782062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 811/1626] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:07.782062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568e2c4-47b4-45a5-94d4-38a441049095 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:07.798140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568e2c4-47b4-45a5-94d4-38a441049095 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:07.810863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab9bc4-e445-4b02-866a-c80a20ae431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:07.811665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9bc4-e445-4b02-866a-c80a20ae431d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.812338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9bc4-e445-4b02-866a-c80a20ae431d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.812726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab9bc4-e445-4b02-866a-c80a20ae431d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.813718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9bc4-e445-4b02-866a-c80a20ae431d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.818606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-65234b50-12e2-4dbe-a39c-226d182a7ebf None None] MFA Rules not processed for user `c9b1f1ed2fe14f66a3c74642daf4aa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:07.822590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab9bc4-e445-4b02-866a-c80a20ae431d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.822789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-65234b50-12e2-4dbe-a39c-226d182a7ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:07.840860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 812/1627] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:07.846244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef236-8dc8-4bd6-976c-2bf9ad10843c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.846554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef236-8dc8-4bd6-976c-2bf9ad10843c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.846840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ef236-8dc8-4bd6-976c-2bf9ad10843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.866682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-566ef236-8dc8-4bd6-976c-2bf9ad10843c None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:07.867888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-566ef236-8dc8-4bd6-976c-2bf9ad10843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:07.928162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 816/1628] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:07.930087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234b50-12e2-4dbe-a39c-226d182a7ebf None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:07.943254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234b50-12e2-4dbe-a39c-226d182a7ebf None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:07.948451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:07.952201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.952499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.952785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.953650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:07.956970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:07.967244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 813/1629] 10.222.0.87 () {58 vars in 1058 bytes} [Wed Feb 16 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:07.974169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d26ab-9703-4ad8-9ca0-09213aae2c4b None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:07.974819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d26ab-9703-4ad8-9ca0-09213aae2c4b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:07.975375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d26ab-9703-4ad8-9ca0-09213aae2c4b None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:07.980301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 814/1630] 10.222.0.87 () {54 vars in 912 bytes} [Wed Feb 16 18:20:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:20:07.987275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d26ab-9703-4ad8-9ca0-09213aae2c4b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.005278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d26ab-9703-4ad8-9ca0-09213aae2c4b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:08.016571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:08.018654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.019010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.019565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] PATH_INFO: `/v3/projects/a28ece692c624dfda670785ee4e51a0a/users/3c27b01a4432403aa14f15b33e21e31f/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.046259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28ece692c624dfda670785ee4e51a0a, user_id=3c27b01a4432403aa14f15b33e21e31f, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:08.049772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:08.089921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 817/1631] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:07 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:08.089921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.124306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 815/1632] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:07 2022] PUT /identity/v3/projects/a28ece692c624dfda670785ee4e51a0a/users/3c27b01a4432403aa14f15b33e21e31f/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:08.125073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.236304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3b5e0-aa7d-418e-ab07-18dca4e56b75 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:08.307964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceff7e-bc88-48cf-9ef4-74dbb2a1d23c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:08.341516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9430-e421-43bf-b230-ec0b62f358a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:08.342592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9430-e421-43bf-b230-ec0b62f358a0 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.343112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9430-e421-43bf-b230-ec0b62f358a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.345700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9430-e421-43bf-b230-ec0b62f358a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.391418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f871fd0-6d89-4174-a5af-74e67dabf9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:08.393520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f871fd0-6d89-4174-a5af-74e67dabf9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.394767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f871fd0-6d89-4174-a5af-74e67dabf9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.395267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f871fd0-6d89-4174-a5af-74e67dabf9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.396223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f871fd0-6d89-4174-a5af-74e67dabf9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:08.399734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f871fd0-6d89-4174-a5af-74e67dabf9d4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:08.509776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9430-e421-43bf-b230-ec0b62f358a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:08.514211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9430-e421-43bf-b230-ec0b62f358a0 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:08.531840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 816/1633] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:08.535108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6cd4-92e1-4525-8529-44565c237239 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.535576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6cd4-92e1-4525-8529-44565c237239 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.536033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6cd4-92e1-4525-8529-44565c237239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.555970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 818/1634] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:08 2022] POST /identity/v3/projects => generated 365 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:08.558770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd223-4c04-4156-8d2d-73d6acdbe6f6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.559344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd223-4c04-4156-8d2d-73d6acdbe6f6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.559876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5dd223-4c04-4156-8d2d-73d6acdbe6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.570122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-882c6cd4-92e1-4525-8529-44565c237239 None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:08.571340 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-882c6cd4-92e1-4525-8529-44565c237239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:08.595053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0d5dd223-4c04-4156-8d2d-73d6acdbe6f6 None None] MFA Rules not processed for user `a3c5aec16fa247608455d563967032a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:08.596508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0d5dd223-4c04-4156-8d2d-73d6acdbe6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:08.690836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 819/1635] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:08.691823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd223-4c04-4156-8d2d-73d6acdbe6f6 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.704973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 817/1636] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:08.704973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c6cd4-92e1-4525-8529-44565c237239 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.784292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5dd223-4c04-4156-8d2d-73d6acdbe6f6 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:08.797666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b89384-cb87-49d5-80b3-4b15a6eb4afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:08.797867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c6cd4-92e1-4525-8529-44565c237239 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:08.799178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b89384-cb87-49d5-80b3-4b15a6eb4afc admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.799556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b89384-cb87-49d5-80b3-4b15a6eb4afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.799898 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b89384-cb87-49d5-80b3-4b15a6eb4afc admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.800790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b89384-cb87-49d5-80b3-4b15a6eb4afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:08.803929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b89384-cb87-49d5-80b3-4b15a6eb4afc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:08.804419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:08.805367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.805658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.806094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.806840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:08.809311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:08.824210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 818/1637] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:08.825355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.839755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ece1a7-e9e3-4e32-a27a-8754b314608a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:08.845575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:08.846327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.846657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.846965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.847630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:08.849658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:08.899989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 820/1638] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:08 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:08.901707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d119fc-4d0f-46fc-a88f-a9c3a3e4e031 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.902072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d119fc-4d0f-46fc-a88f-a9c3a3e4e031 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.902480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d119fc-4d0f-46fc-a88f-a9c3a3e4e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.928348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-47d119fc-4d0f-46fc-a88f-a9c3a3e4e031 None None] MFA Rules not processed for user `a3c5aec16fa247608455d563967032a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:08.930774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-47d119fc-4d0f-46fc-a88f-a9c3a3e4e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:08.934625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 819/1639] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:08 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:08.937461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.944510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 821/1640] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:08.944510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5684e-83b4-4892-b35e-053675bb6225 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.944510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5684e-83b4-4892-b35e-053675bb6225 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.944510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5684e-83b4-4892-b35e-053675bb6225 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.948851 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 822/1641] 10.222.0.87 () {54 vars in 912 bytes} [Wed Feb 16 18:20:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:20:08.949954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5684e-83b4-4892-b35e-053675bb6225 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:08.970780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5684e-83b4-4892-b35e-053675bb6225 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:08.976145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:08.977124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:08.977498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:08.977922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] PATH_INFO: `/v3/projects/a28ece692c624dfda670785ee4e51a0a/users/3c27b01a4432403aa14f15b33e21e31f/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:08.980600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28ece692c624dfda670785ee4e51a0a, user_id=3c27b01a4432403aa14f15b33e21e31f, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:08.984139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:08.998693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 823/1642] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:08 2022] PUT /identity/v3/projects/a28ece692c624dfda670785ee4e51a0a/users/3c27b01a4432403aa14f15b33e21e31f/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:08.999287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.027243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa01f51-419d-4294-939a-78d3a59820c3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.088688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03535f5-64bf-4a7a-a8fc-b8dc071b7b62 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.094550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.094942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.096009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.096464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.096824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.097357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.097740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.098048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.098507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.099809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.113857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 824/1643] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:09.114833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.126946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9a11-51e7-4130-9d18-f2e9c9b39b79 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.133016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a882-396d-49e9-8cb6-d05cc4551a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.133016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a882-396d-49e9-8cb6-d05cc4551a05 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.134354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a882-396d-49e9-8cb6-d05cc4551a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.134753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a882-396d-49e9-8cb6-d05cc4551a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.135566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a882-396d-49e9-8cb6-d05cc4551a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.137332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a882-396d-49e9-8cb6-d05cc4551a05 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.149030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 825/1644] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:09.150519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf5a27-5ce3-46df-a7ad-a27d2edeae7d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.150880 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf5a27-5ce3-46df-a7ad-a27d2edeae7d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.151230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf5a27-5ce3-46df-a7ad-a27d2edeae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.172384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-addf5a27-5ce3-46df-a7ad-a27d2edeae7d None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:09.174077 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-addf5a27-5ce3-46df-a7ad-a27d2edeae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:09.185816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.190522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.196013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 826/1645] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:09.196013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f860c99-8921-4735-ab59-8736b967eeee None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.196013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f860c99-8921-4735-ab59-8736b967eeee None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.196013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f860c99-8921-4735-ab59-8736b967eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.206146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 820/1646] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:09.207180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.221928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724055f8-d810-4333-98af-504e04074f41 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.232957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.236384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.236951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.237280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] PATH_INFO: `/v3/projects/74366a46ad694b5790aae9a21e2d29a4/users/fa0b2c814945400892d5ff2b35fd320b/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.238608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6f860c99-8921-4735-ab59-8736b967eeee None None] MFA Rules not processed for user `3c27b01a4432403aa14f15b33e21e31f`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:09.239850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6f860c99-8921-4735-ab59-8736b967eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:09.270264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74366a46ad694b5790aae9a21e2d29a4, user_id=fa0b2c814945400892d5ff2b35fd320b, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.276749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.324929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 827/1647] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:09.324929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f860c99-8921-4735-ab59-8736b967eeee None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.336025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f860c99-8921-4735-ab59-8736b967eeee None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.341483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.342377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.342717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.343048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] PATH_INFO: `/v3/projects/d34d119c1ec34fb9b659b8ce57dbcedf/users/22b4abcde30b4a23b906ff6faa32cfa8/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.362280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34d119c1ec34fb9b659b8ce57dbcedf, user_id=22b4abcde30b4a23b906ff6faa32cfa8, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.365815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.380813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 821/1648] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:09 2022] PUT /identity/v3/projects/74366a46ad694b5790aae9a21e2d29a4/users/fa0b2c814945400892d5ff2b35fd320b/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:09.380813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.438064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebe146-da8f-4ee3-b6f1-31e430486844 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.443044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.443697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.444050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.444250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.482084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 828/1649] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:09 2022] PUT /identity/v3/projects/d34d119c1ec34fb9b659b8ce57dbcedf/users/22b4abcde30b4a23b906ff6faa32cfa8/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:09.483630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.530815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.532271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.544628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 822/1650] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:09.545116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.572166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b49420-5e9d-4e19-a21b-5eeec17d0405 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.584517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.585389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.585679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.585962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.586703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.589590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.608615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 829/1651] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:09.608615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.643149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce004cb-9f6f-441e-962d-99f17f3dd0f9 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.655322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.658536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.658536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.658536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.658536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.659233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.671804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 823/1652] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:09.672836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.716852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe2e4-ac14-4628-b209-37638b595fdb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.735692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.736589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.736990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.737215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.768039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445da1-bb6d-413e-9e3b-b6f1222b8c04 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.774438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3693-32ed-4def-af18-4594053296e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.775263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3693-32ed-4def-af18-4594053296e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.775662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3693-32ed-4def-af18-4594053296e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.776535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3693-32ed-4def-af18-4594053296e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.811882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.815175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.837293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 830/1653] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:09.838384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.856456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66006832-04e6-4f1f-a99a-b4d5825aad3d service nova] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:09.866873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:09.868083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.868462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.868815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] PATH_INFO: `/v3/projects/74366a46ad694b5790aae9a21e2d29a4/users/fa0b2c814945400892d5ff2b35fd320b/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.870481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3693-32ed-4def-af18-4594053296e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.871338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74366a46ad694b5790aae9a21e2d29a4, user_id=fa0b2c814945400892d5ff2b35fd320b, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:09.872961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3693-32ed-4def-af18-4594053296e4 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.874599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:09.889512 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 831/1654] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:09 2022] PUT /identity/v3/projects/74366a46ad694b5790aae9a21e2d29a4/users/fa0b2c814945400892d5ff2b35fd320b/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:09.890675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:09.911575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 824/1655] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:09.913153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5cf3-6348-443f-9eb6-72ef4d948e5c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:09.916844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5cf3-6348-443f-9eb6-72ef4d948e5c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:09.916961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a5cf3-6348-443f-9eb6-72ef4d948e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:09.994059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-419a5cf3-6348-443f-9eb6-72ef4d948e5c None None] MFA Rules not processed for user `fa0b2c814945400892d5ff2b35fd320b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:09.995356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-419a5cf3-6348-443f-9eb6-72ef4d948e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:10.029501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c90e3d-532b-4a84-b4a3-fe1410ef4a6f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:10.082114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd6f13-816b-4437-85d8-abf5ce86ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:10.083192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd6f13-816b-4437-85d8-abf5ce86ed8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:10.083582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd6f13-816b-4437-85d8-abf5ce86ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:10.083967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd6f13-816b-4437-85d8-abf5ce86ed8c admin admin] PATH_INFO: `/v3/projects/d34d119c1ec34fb9b659b8ce57dbcedf/users/22b4abcde30b4a23b906ff6faa32cfa8/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:10.089122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd6f13-816b-4437-85d8-abf5ce86ed8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34d119c1ec34fb9b659b8ce57dbcedf, user_id=22b4abcde30b4a23b906ff6faa32cfa8, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:10.093967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd6f13-816b-4437-85d8-abf5ce86ed8c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:10.110677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 832/1656] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:09 2022] PUT /identity/v3/projects/d34d119c1ec34fb9b659b8ce57dbcedf/users/22b4abcde30b4a23b906ff6faa32cfa8/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:10.124424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51767-da4a-4a62-b2c7-c69faabd108a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:10.124849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51767-da4a-4a62-b2c7-c69faabd108a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:10.125281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51767-da4a-4a62-b2c7-c69faabd108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:10.166989 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 825/1657] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:10.179178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5cf3-6348-443f-9eb6-72ef4d948e5c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:10.218159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-08c51767-da4a-4a62-b2c7-c69faabd108a None None] MFA Rules not processed for user `22b4abcde30b4a23b906ff6faa32cfa8`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:10.223271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-08c51767-da4a-4a62-b2c7-c69faabd108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:10.273735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a5cf3-6348-443f-9eb6-72ef4d948e5c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:10.340233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 833/1658] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:10.340233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51767-da4a-4a62-b2c7-c69faabd108a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:10.356497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b2f72-1738-4ca5-bd62-b09e43f6c2d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:10.357323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2f72-1738-4ca5-bd62-b09e43f6c2d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:10.357624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2f72-1738-4ca5-bd62-b09e43f6c2d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:10.357904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2f72-1738-4ca5-bd62-b09e43f6c2d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:10.452444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51767-da4a-4a62-b2c7-c69faabd108a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:10.470465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:10.471146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:10.471434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:10.472302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:10.487919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2f72-1738-4ca5-bd62-b09e43f6c2d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:10.489410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2f72-1738-4ca5-bd62-b09e43f6c2d0 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:10.514820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 826/1659] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:10.534709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f845-3299-4cb1-b008-bc2d592b3998 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:10.535334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f845-3299-4cb1-b008-bc2d592b3998 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:10.535334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f845-3299-4cb1-b008-bc2d592b3998 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:10.537345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 827/1660] 10.222.0.87 () {54 vars in 912 bytes} [Wed Feb 16 18:20:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:20:10.543690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada0d3-6a04-49ac-9fe3-ba4b87b0a9c9 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:10.544038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada0d3-6a04-49ac-9fe3-ba4b87b0a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:10.544297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ada0d3-6a04-49ac-9fe3-ba4b87b0a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:10.557449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:10.559199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:10.584232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 834/1661] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:10.598373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d6ada0d3-6a04-49ac-9fe3-ba4b87b0a9c9 None None] MFA Rules not processed for user `9b842d30b55c48bf8f375bdcc829bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:10.599861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d6ada0d3-6a04-49ac-9fe3-ba4b87b0a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:10.678351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 828/1662] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:20:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:10.694634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:10.705790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51deb-7e7e-413c-af74-c793ab745dd8 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:10.709748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef9f80-444b-4808-8b8b-e7fb2716fd3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:10.710531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9f80-444b-4808-8b8b-e7fb2716fd3f service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:10.710985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9f80-444b-4808-8b8b-e7fb2716fd3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:10.711270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9f80-444b-4808-8b8b-e7fb2716fd3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:10.719060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef9f80-444b-4808-8b8b-e7fb2716fd3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:10.720968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef9f80-444b-4808-8b8b-e7fb2716fd3f service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:10.728999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 835/1663] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:11.219025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ada0d3-6a04-49ac-9fe3-ba4b87b0a9c9 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:11.242826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ada0d3-6a04-49ac-9fe3-ba4b87b0a9c9 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:11.255828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c103643-01ec-4294-8e64-f4b6eb00f68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:11.257043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103643-01ec-4294-8e64-f4b6eb00f68e service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:11.257043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103643-01ec-4294-8e64-f4b6eb00f68e service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:11.258691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c103643-01ec-4294-8e64-f4b6eb00f68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:11.281048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c103643-01ec-4294-8e64-f4b6eb00f68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:11.282988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c103643-01ec-4294-8e64-f4b6eb00f68e service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:11.297424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 829/1664] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:11.451199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd96d6-0426-418c-b1c0-b41825cdf8db None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:11.451564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd96d6-0426-418c-b1c0-b41825cdf8db None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:11.451870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd96d6-0426-418c-b1c0-b41825cdf8db None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:11.453778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 836/1665] 10.222.0.87 () {54 vars in 960 bytes} [Wed Feb 16 18:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:20:11.465366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86728-4b5b-4e3c-a02e-1cc5520a43ee None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:11.465366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86728-4b5b-4e3c-a02e-1cc5520a43ee None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:11.465366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86728-4b5b-4e3c-a02e-1cc5520a43ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:11.503023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-aad86728-4b5b-4e3c-a02e-1cc5520a43ee None None] MFA Rules not processed for user `6b08679e2a634bf08a279b6d8a9ffc46`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:11.509703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-aad86728-4b5b-4e3c-a02e-1cc5520a43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:11.643423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 830/1666] 10.222.0.87 () {58 vars in 1057 bytes} [Wed Feb 16 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:11.654242 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd96d6-0426-418c-b1c0-b41825cdf8db None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:11.711336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd96d6-0426-418c-b1c0-b41825cdf8db None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:11.718668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:11.721714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:11.724001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:11.724293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:11.729131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:11.776263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:11.779491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:11.848583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 837/1667] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:11.885554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86728-4b5b-4e3c-a02e-1cc5520a43ee None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:12.085017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86728-4b5b-4e3c-a02e-1cc5520a43ee None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:12.092018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:12.093061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:12.093609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:12.093991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] PATH_INFO: `/v3/users/a31cad5460ee494c8af2b7f8f340905d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:12.096834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31cad5460ee494c8af2b7f8f340905d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:12.099372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:12.264869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31cad5460ee494c8af2b7f8f340905d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.266647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31cad5460ee494c8af2b7f8f340905d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.287548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31cad5460ee494c8af2b7f8f340905d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.288346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31cad5460ee494c8af2b7f8f340905d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.296078 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-36eaddce-d4ec-4bb7-bc9d-00c66e7c57b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31cad5460ee494c8af2b7f8f340905d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.304501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:12.322617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02405d2-366b-4349-b035-9999209ab44f service placement] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:12.344392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:12.345977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:12.346763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:12.348265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] PATH_INFO: `/v3/users/c9b1f1ed2fe14f66a3c74642daf4aa3a` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:12.356683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b1f1ed2fe14f66a3c74642daf4aa3a)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:12.356683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: WARNING py.warnings [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:20:12.356683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: warnings.warn(msg) Feb 16 18:20:12.356683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: Feb 16 18:20:12.381954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:12.429276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 831/1668] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:11 2022] DELETE /identity/v3/users/a31cad5460ee494c8af2b7f8f340905d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:12.436442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:12.436442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:12.436442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:12.483355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:12.483355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:12.585286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 832/1669] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:12.587576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:12.589088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:12.668091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcee5a-5706-40b7-aa73-ca11a64ed748 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:12.681195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e035935-7139-4fe3-8eb8-d37e54b74c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:12.681882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e035935-7139-4fe3-8eb8-d37e54b74c20 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:12.682169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e035935-7139-4fe3-8eb8-d37e54b74c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:12.682503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e035935-7139-4fe3-8eb8-d37e54b74c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:12.688403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b1f1ed2fe14f66a3c74642daf4aa3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.690268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b1f1ed2fe14f66a3c74642daf4aa3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.704236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b1f1ed2fe14f66a3c74642daf4aa3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.706313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e035935-7139-4fe3-8eb8-d37e54b74c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:12.707785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e035935-7139-4fe3-8eb8-d37e54b74c20 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:12.721002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 833/1670] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:20:12.739276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b1f1ed2fe14f66a3c74642daf4aa3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.740041 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b1f1ed2fe14f66a3c74642daf4aa3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:12.884752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 838/1671] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:12 2022] DELETE /identity/v3/users/c9b1f1ed2fe14f66a3c74642daf4aa3a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:12.889202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:12.889490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:12.889786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:12.934230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:12.935774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:13.072006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 834/1672] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:13.112368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:13.114198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:13.202145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf86d-d746-4022-b5a0-530079b65bb5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:13.207792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:13.208714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:13.209241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:13.209695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:13.225422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:13.227558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:13.241327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 839/1673] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:13.418433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:13.428773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:13.441484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685b3fb-dd74-4788-844b-c8b92b7a4252 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:13.447295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:13.448175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:13.448464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:13.448745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] PATH_INFO: `/v3/projects/339ea1b3310e461bb59b1473f0ad5b22` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:13.450296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339ea1b3310e461bb59b1473f0ad5b22)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:13.451370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: WARNING py.warnings [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 18:20:13.451370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: warnings.warn(msg) Feb 16 18:20:13.451370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: Feb 16 18:20:13.452860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:13.594743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339ea1b3310e461bb59b1473f0ad5b22', 'request_id': 'req-2880100f-db9c-4149-9b18-027b5ad58345'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:13.662744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:13.665479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:13.677178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339ea1b3310e461bb59b1473f0ad5b22', 'request_id': 'req-2880100f-db9c-4149-9b18-027b5ad58345'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:13.688192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339ea1b3310e461bb59b1473f0ad5b22', 'request_id': 'req-2880100f-db9c-4149-9b18-027b5ad58345'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:13.715357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62a40f-7d45-4c1a-9efe-c4c47404663c service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:13.762420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] The token cache is being invalidate because project 339ea1b3310e461bb59b1473f0ad5b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:13.762565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:13.767608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2880100f-db9c-4149-9b18-027b5ad58345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:13.774498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 835/1674] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:13 2022] DELETE /identity/v3/projects/339ea1b3310e461bb59b1473f0ad5b22 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:13.779941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:13.780243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:13.780526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:13.829804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:13.831097 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:13.897791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:13.901559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:13.901846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:13.902126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] PATH_INFO: `/v3/users/4d489f11dc814054973894e02f6b681b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:13.904324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d489f11dc814054973894e02f6b681b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:13.906346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:13.999836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 836/1675] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:14.001181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:14.002560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:14.074136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277db1e-3159-42ca-b3fc-aa66e755e621 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:14.096957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579c13-722f-425e-a6c1-12c8221a6178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:14.097697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579c13-722f-425e-a6c1-12c8221a6178 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:14.097989 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579c13-722f-425e-a6c1-12c8221a6178 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:14.098272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579c13-722f-425e-a6c1-12c8221a6178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:14.104426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-29579c13-722f-425e-a6c1-12c8221a6178 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:14.248632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579c13-722f-425e-a6c1-12c8221a6178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:14.250764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579c13-722f-425e-a6c1-12c8221a6178 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:14.273555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 837/1676] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:14.275891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df876f-c37f-448c-8334-21da651965b2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:14.276384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df876f-c37f-448c-8334-21da651965b2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:14.276845 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df876f-c37f-448c-8334-21da651965b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:14.291532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d489f11dc814054973894e02f6b681b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:14.292648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d489f11dc814054973894e02f6b681b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:14.573814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d489f11dc814054973894e02f6b681b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:14.577327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-95df876f-c37f-448c-8334-21da651965b2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:14.577327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-95df876f-c37f-448c-8334-21da651965b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:14.577574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d489f11dc814054973894e02f6b681b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:14.577574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-01b11dde-4160-479d-aba0-d2ce8efd6402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d489f11dc814054973894e02f6b681b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:14.577782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 838/1677] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:14.577782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df876f-c37f-448c-8334-21da651965b2 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:14.577782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df876f-c37f-448c-8334-21da651965b2 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:14.577782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:14.578093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:14.578093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:14.578093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:14.578093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:14.578093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:14.578093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:14.578462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 839/1678] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:14.578462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:14.578462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18548-d044-446d-ad06-7d6c8982eaef admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:14.578462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:14.578721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:14.578721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:14.578721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:14.578721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:14.578721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:14.578952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 840/1679] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:13 2022] DELETE /identity/v3/users/4d489f11dc814054973894e02f6b681b => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:14.578952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:14.578952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:14.578952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:14.578952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:14.578952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:14.681598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 841/1680] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:14.683325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:14.710215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:14.710215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f361e4-12f8-4018-82ac-d96ee19ca96c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:14.711606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:14.712492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:14.712899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:14.713341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] PATH_INFO: `/v3/projects/b362f8ebf3754634a11d802a8fb65752` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:14.714862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b362f8ebf3754634a11d802a8fb65752)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:14.717490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:14.771080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 840/1681] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:14 2022] POST /identity/v3/projects => generated 405 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:14.772632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:14.774458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:14.870095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5394c-36b6-4180-8584-442d77798ab8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:14.881712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b362f8ebf3754634a11d802a8fb65752', 'request_id': 'req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:14.974296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b362f8ebf3754634a11d802a8fb65752', 'request_id': 'req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:14.990095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:14.990772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:14.991057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:14.991334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:14.992964 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b362f8ebf3754634a11d802a8fb65752', 'request_id': 'req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.008275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] The token cache is being invalidate because project b362f8ebf3754634a11d802a8fb65752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:15.008677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.010841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.024914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 842/1682] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:14 2022] DELETE /identity/v3/projects/b362f8ebf3754634a11d802a8fb65752 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:15.026372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:15.028191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:15.175602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:15.179401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:15.202427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ddbc-97db-4db2-9b57-3cf11f9d6dcb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:15.208897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 841/1683] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:15.210372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:15.218273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:15.219053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:15.219570 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:15.220057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:15.221444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:15.224573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:15.232706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc782e19-fd38-40e2-b41f-11bb54cb0278 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:15.243876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:15.244871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:15.245217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:15.245499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] PATH_INFO: `/v3/users/22b4abcde30b4a23b906ff6faa32cfa8` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:15.246950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b4abcde30b4a23b906ff6faa32cfa8)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:15.249036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:15.339084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 843/1684] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:15 2022] POST /identity/v3/users => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:15.340675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:15.354601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a30bff-4bc2-4207-96c8-f41ab324ee4a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:15.360868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:15.362799 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:15.363295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:15.363751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:15.364689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:15.366737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:15.383143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 844/1685] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:15.387068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:15.399270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5a472-a04d-433e-bc71-d83f69edd080 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:15.411798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:15.413808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:15.414201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:15.414582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:15.416273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:15.419666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:15.459148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 845/1686] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:15.476153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:15.507727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8670-9c94-43d0-8d51-f64af23cdb88 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:15.518286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546fdc9-86af-4930-be46-629c3c7d5a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:15.519852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546fdc9-86af-4930-be46-629c3c7d5a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:15.520218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546fdc9-86af-4930-be46-629c3c7d5a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:15.520447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546fdc9-86af-4930-be46-629c3c7d5a4a admin admin] PATH_INFO: `/v3/projects/f38d7eefd888465a8a7cc60361612d26/users/58552b131cde4526b272f5f44a290279/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:15.546345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546fdc9-86af-4930-be46-629c3c7d5a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38d7eefd888465a8a7cc60361612d26, user_id=58552b131cde4526b272f5f44a290279, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:15.551029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b4abcde30b4a23b906ff6faa32cfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.552349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546fdc9-86af-4930-be46-629c3c7d5a4a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:15.569036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b4abcde30b4a23b906ff6faa32cfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.608550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b4abcde30b4a23b906ff6faa32cfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.617644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b4abcde30b4a23b906ff6faa32cfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.636591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 846/1687] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:15 2022] PUT /identity/v3/projects/f38d7eefd888465a8a7cc60361612d26/users/58552b131cde4526b272f5f44a290279/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:15.648423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:15.648761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:15.649009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:15.677453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b4abcde30b4a23b906ff6faa32cfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:15.722707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] MFA Rules not processed for user `58552b131cde4526b272f5f44a290279`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:15.724981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:15.759622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 842/1688] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:15 2022] DELETE /identity/v3/users/22b4abcde30b4a23b906ff6faa32cfa8 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:15.924255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 847/1689] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:15.924461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:15.925281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:16.145884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b207ab1-94a3-444d-96ca-a54d3e68fa78 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:16.151369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:16.151937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:16.152507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:16.152786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:16.153542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:16.155575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:16.184580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:16.187026 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:16.311516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 843/1690] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:15 2022] POST /identity/v3/projects => generated 405 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:16.312961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:16.434682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99ed8c-e7d6-4c8b-83b1-589ee3615cf8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:16.445287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad21fd-aee2-496c-a27e-cce44d9f6761 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:16.445692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:16.447153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:16.447667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:16.448182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] PATH_INFO: `/v3/projects/efbdb7c40fd94d5498cfb15faf9f047b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:16.451761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:16.452301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbdb7c40fd94d5498cfb15faf9f047b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:16.453193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:16.453686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:16.454985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:16.455819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:16.457508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:16.458193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:16.547077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 844/1691] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:16 2022] POST /identity/v3/users => generated 309 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:16.556310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:16.589373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ad38-38d3-4868-8d5a-c639d96db0aa admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:16.618047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbdb7c40fd94d5498cfb15faf9f047b', 'request_id': 'req-406a25de-9d37-4e40-b971-61b12fc2cb83'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:16.694902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fa92c-fbed-4543-92e1-3c20c399e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:16.696271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa92c-fbed-4543-92e1-3c20c399e395 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:16.696755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa92c-fbed-4543-92e1-3c20c399e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:16.697381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fa92c-fbed-4543-92e1-3c20c399e395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:16.697934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fa92c-fbed-4543-92e1-3c20c399e395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:16.699838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fa92c-fbed-4543-92e1-3c20c399e395 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:16.715190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 845/1692] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:16.716744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbdb7c40fd94d5498cfb15faf9f047b', 'request_id': 'req-406a25de-9d37-4e40-b971-61b12fc2cb83'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:16.721637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be45009-12ff-45e2-8ab4-1d1256f25ef3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:16.722164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be45009-12ff-45e2-8ab4-1d1256f25ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:16.722671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be45009-12ff-45e2-8ab4-1d1256f25ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:16.724667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbdb7c40fd94d5498cfb15faf9f047b', 'request_id': 'req-406a25de-9d37-4e40-b971-61b12fc2cb83'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:16.740693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] The token cache is being invalidate because project efbdb7c40fd94d5498cfb15faf9f047b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:16.741497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:16.742358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:16.743984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 848/1693] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:16 2022] DELETE /identity/v3/projects/efbdb7c40fd94d5498cfb15faf9f047b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:16.744805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:16.750329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:16.764430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a25de-9d37-4e40-b971-61b12fc2cb83 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:16.771688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:16.772630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:16.772919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:16.773237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] PATH_INFO: `/v3/projects/bb986b5e3d034b6bb4bec125bb4c81d8/users/3ade88226a12486798cc8e3752ae5937/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:16.780858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6be45009-12ff-45e2-8ab4-1d1256f25ef3 None None] MFA Rules not processed for user `9463920d27f94ad688f3850e88795c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:16.782897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6be45009-12ff-45e2-8ab4-1d1256f25ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:16.794587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb986b5e3d034b6bb4bec125bb4c81d8, user_id=3ade88226a12486798cc8e3752ae5937, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:16.801057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:16.895542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 846/1694] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:16.897637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fffd61-2190-4058-801c-37a27b3fa6a7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:16.897991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fffd61-2190-4058-801c-37a27b3fa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:16.898366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fffd61-2190-4058-801c-37a27b3fa6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:16.922137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 849/1695] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:16 2022] PUT /identity/v3/projects/bb986b5e3d034b6bb4bec125bb4c81d8/users/3ade88226a12486798cc8e3752ae5937/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:16.923346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:16.928988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:16.936500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b5fffd61-2190-4058-801c-37a27b3fa6a7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:16.946661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b5fffd61-2190-4058-801c-37a27b3fa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:17.130546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96bf7-e738-4a63-9e04-31f4ab2471f9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.142327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.144246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.145237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.146337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] PATH_INFO: `/v3/projects/d34d119c1ec34fb9b659b8ce57dbcedf` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.152458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34d119c1ec34fb9b659b8ce57dbcedf)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.157868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:17.158217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 847/1696] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:17.164429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fffd61-2190-4058-801c-37a27b3fa6a7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.201531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fffd61-2190-4058-801c-37a27b3fa6a7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.209315 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.210406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.210964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.211371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.212636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.219779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:17.231868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 848/1697] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:17.233335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.235743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:17.344137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae2ccd-b127-42dd-923d-62215a6c9c00 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.347066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34d119c1ec34fb9b659b8ce57dbcedf', 'request_id': 'req-685e2dff-5c44-4d23-9155-b398409a6c52'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:17.407747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34d119c1ec34fb9b659b8ce57dbcedf', 'request_id': 'req-685e2dff-5c44-4d23-9155-b398409a6c52'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:17.415042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34d119c1ec34fb9b659b8ce57dbcedf', 'request_id': 'req-685e2dff-5c44-4d23-9155-b398409a6c52'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:17.418286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.419073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.419366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.419917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.434317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] The token cache is being invalidate because project d34d119c1ec34fb9b659b8ce57dbcedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:17.434317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:17.435035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-685e2dff-5c44-4d23-9155-b398409a6c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:17.436553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 850/1698] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:16 2022] DELETE /identity/v3/projects/d34d119c1ec34fb9b659b8ce57dbcedf => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:17.438158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abe00d-bf03-49ef-af0c-5811467d1beb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.439330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abe00d-bf03-49ef-af0c-5811467d1beb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.439330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abe00d-bf03-49ef-af0c-5811467d1beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.469417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f9abe00d-bf03-49ef-af0c-5811467d1beb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:17.469417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f9abe00d-bf03-49ef-af0c-5811467d1beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:17.497513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.499298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:17.532800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 849/1699] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:17.533909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.570239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 851/1700] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:17.570781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aa730-58f6-4c99-a382-ccf3abc8e4f8 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.571271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aa730-58f6-4c99-a382-ccf3abc8e4f8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.571738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aa730-58f6-4c99-a382-ccf3abc8e4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.601434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c44aa730-58f6-4c99-a382-ccf3abc8e4f8 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:17.602956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c44aa730-58f6-4c99-a382-ccf3abc8e4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:17.613007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 852/1701] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:17.614390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aa730-58f6-4c99-a382-ccf3abc8e4f8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.627397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aa730-58f6-4c99-a382-ccf3abc8e4f8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.633918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.634106 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587902-72bd-4fd5-9f45-f5aaa1eb6ef3 service nova] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.635479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.636014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.636437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.637381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:17.638292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.640144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:17.640334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49d40b-fc54-4a24-9fe2-7af7160815fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.642524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d40b-fc54-4a24-9fe2-7af7160815fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.642524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d40b-fc54-4a24-9fe2-7af7160815fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.643142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49d40b-fc54-4a24-9fe2-7af7160815fc admin admin] PATH_INFO: `/v3/projects/bb986b5e3d034b6bb4bec125bb4c81d8/users/3ade88226a12486798cc8e3752ae5937/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.645205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49d40b-fc54-4a24-9fe2-7af7160815fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb986b5e3d034b6bb4bec125bb4c81d8, user_id=3ade88226a12486798cc8e3752ae5937, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.648383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49d40b-fc54-4a24-9fe2-7af7160815fc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:17.662580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 853/1703] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:17.663903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 850/1703] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:17 2022] PUT /identity/v3/projects/bb986b5e3d034b6bb4bec125bb4c81d8/users/3ade88226a12486798cc8e3752ae5937/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:17.664269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84955-341d-4738-91b8-07ccd080187d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.671581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84955-341d-4738-91b8-07ccd080187d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.671581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84955-341d-4738-91b8-07ccd080187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.678990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.689595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eafea-4f94-4295-bf0f-06cc9e37dc45 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.693011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-26e84955-341d-4738-91b8-07ccd080187d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:17.694442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-26e84955-341d-4738-91b8-07ccd080187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:17.757008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.758285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.758844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.759280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.760490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.765036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:17.769021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 851/1704] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:17.770664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dad3c2-9b07-4671-ba8b-20f38d49e24e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.771111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dad3c2-9b07-4671-ba8b-20f38d49e24e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.771513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dad3c2-9b07-4671-ba8b-20f38d49e24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.805314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-12dad3c2-9b07-4671-ba8b-20f38d49e24e None None] MFA Rules not processed for user `3ade88226a12486798cc8e3752ae5937`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:17.806708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-12dad3c2-9b07-4671-ba8b-20f38d49e24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:17.859721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 854/1705] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:17 2022] POST /identity/v3/projects => generated 403 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:17.862035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.898902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 852/1706] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:17.899947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dad3c2-9b07-4671-ba8b-20f38d49e24e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.912108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dad3c2-9b07-4671-ba8b-20f38d49e24e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.949213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2802-1fac-42fb-8266-b12d7eec5706 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:17.956538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.957727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.958217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.958842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.960133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:17.960656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.963614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:17.980853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 855/1707] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:17.980853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:17.980853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:17.991035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:17.991985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:17.992345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:17.992689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:17.993511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:17.995679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.056539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14117e-da2f-4850-b7c3-96276961c909 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.062431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.062431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.062431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.062431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.122960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 853/1708] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:17 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:18.123794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.138224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099bebb-ff66-4bd9-96d7-b570948135dc admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.139660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.142316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.146880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.148009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.148123 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.148356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.149180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.151151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.154779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 856/1709] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:18.155745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.172029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ef454-5ab5-442f-94fa-a826614cff2e service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.183390 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.185968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.186939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.186939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.195023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.199278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.228584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 857/1710] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:18.230372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.245816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2c9f-db79-447a-a242-a7d5394e6be4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.254055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.256842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.257303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.257630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.259005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.260675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.274340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 858/1711] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:18.278302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.292006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b52936-4c13-4221-8fc9-619a9b4d6b22 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.298422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfd7d6-e14d-41e1-a65b-2b2069130b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.302720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd7d6-e14d-41e1-a65b-2b2069130b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.302720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd7d6-e14d-41e1-a65b-2b2069130b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.302720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd7d6-e14d-41e1-a65b-2b2069130b6e admin admin] PATH_INFO: `/v3/projects/c9c036e4fd0541dda19c8bbe71a97a39/users/f4629fa2f6874eb2a6adb2f0dc59c8a7/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.342476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 854/1712] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:18 2022] POST /identity/v3/projects => generated 369 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:18.343292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.356402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfd7d6-e14d-41e1-a65b-2b2069130b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c036e4fd0541dda19c8bbe71a97a39, user_id=f4629fa2f6874eb2a6adb2f0dc59c8a7, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.359168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfd7d6-e14d-41e1-a65b-2b2069130b6e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.426839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd009d8-db2a-4b50-9c94-0e7e21bc05be admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.435335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.436159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.436443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.436757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.437522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.440393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.443503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 859/1713] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:18 2022] PUT /identity/v3/projects/c9c036e4fd0541dda19c8bbe71a97a39/users/f4629fa2f6874eb2a6adb2f0dc59c8a7/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:18.448341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.448632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.448911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.467840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:18.469066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:18.536283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 860/1714] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:18.546187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.549462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 855/1715] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:18 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:20:18.549589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:18.554087 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.563964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d59cfb-38b5-4e08-8af9-6bf457cbcb54 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.568765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.569593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.569887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.570160 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.570884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.572485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.584057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 856/1716] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:18.588735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.599870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d052ab-3158-462d-906f-5c2304a17301 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.608483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.609684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.610118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.611152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.612355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.614061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563743e-d9c9-4a81-a2d0-55b2a9e30477 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.614466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.629377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 857/1717] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:18.632918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:18.633691 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfae50-9221-42c3-a483-392d921cf2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.635276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfae50-9221-42c3-a483-392d921cf2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.635737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfae50-9221-42c3-a483-392d921cf2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.636028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfae50-9221-42c3-a483-392d921cf2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.646516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cadc62-04f6-41b7-ae4b-1a6a460df57b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:18.656763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:18.658804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.659273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.659729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] PATH_INFO: `/v3/projects/3ddf88c40913456187b7cc79b5f50ca6/users/404dcdea3de34c01893427dea87449ff/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.660177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfae50-9221-42c3-a483-392d921cf2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.662489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfae50-9221-42c3-a483-392d921cf2b1 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.675139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 861/1718] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:20:18.681397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddf88c40913456187b7cc79b5f50ca6, user_id=404dcdea3de34c01893427dea87449ff, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:18.684781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:18.793327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 858/1719] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:18 2022] PUT /identity/v3/projects/3ddf88c40913456187b7cc79b5f50ca6/users/404dcdea3de34c01893427dea87449ff/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:18.805211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:18.805730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:18.805817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:18.862815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] MFA Rules not processed for user `404dcdea3de34c01893427dea87449ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:18.864406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:18.935417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 862/1720] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:18.940599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:19.023320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:19.025136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:19.075167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e13ba0-ec2f-4812-9c1a-1fd5fc688134 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:19.082945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:19.083902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:19.084273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:19.084761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:19.086186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:19.088398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:19.151267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e1e8b-96e5-4502-9716-f7e98ab2cdad None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:19.162327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:19.163663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:19.164145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:19.164564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] PATH_INFO: `/v3/users/58552b131cde4526b272f5f44a290279` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:19.166377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58552b131cde4526b272f5f44a290279)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:19.171283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:19.249666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 859/1721] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:18 2022] POST /identity/v3/projects => generated 367 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:19.255340 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:19.430253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2d4e2-19a6-49f2-8433-649e2c5d7569 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:19.437681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:19.438736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:19.439158 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:19.439537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:19.440425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:19.442805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:19.447348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58552b131cde4526b272f5f44a290279'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:19.448272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58552b131cde4526b272f5f44a290279'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:19.483262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58552b131cde4526b272f5f44a290279'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:19.515057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58552b131cde4526b272f5f44a290279'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:19.527153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ab5fa4b8-1f70-4af5-b2fb-cc0909cbdce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58552b131cde4526b272f5f44a290279'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:19.590330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 860/1722] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:19 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:19.594273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:19.598583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:19.620282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071efe-223f-4151-8d92-52a4a88bf4da admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:19.625403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:19.626404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:19.626695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:19.626977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:19.628330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:19.631533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:19.646295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 861/1723] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:19.650595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:19.655308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 863/1724] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:19 2022] DELETE /identity/v3/users/58552b131cde4526b272f5f44a290279 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:19.662165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a1ce6-a314-4132-a556-dfed1bcc6f1f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:19.662782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b642-e53c-4464-a72b-4b685f1840ae admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:19.663138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a1ce6-a314-4132-a556-dfed1bcc6f1f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:19.663730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a1ce6-a314-4132-a556-dfed1bcc6f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:19.706625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ba0a1ce6-a314-4132-a556-dfed1bcc6f1f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:19.709922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ba0a1ce6-a314-4132-a556-dfed1bcc6f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:19.733903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f953-e06c-4ce7-8946-4c6a8a83179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:19.734924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f953-e06c-4ce7-8946-4c6a8a83179f admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:19.735350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f953-e06c-4ce7-8946-4c6a8a83179f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:19.735816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f953-e06c-4ce7-8946-4c6a8a83179f admin admin] PATH_INFO: `/v3/projects/3a3cb5326a6c417db2de3e46abb770f1/users/44cd6ec1a2bc424cab1258c32ad38285/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:19.754077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f953-e06c-4ce7-8946-4c6a8a83179f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3cb5326a6c417db2de3e46abb770f1, user_id=44cd6ec1a2bc424cab1258c32ad38285, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:19.757218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f953-e06c-4ce7-8946-4c6a8a83179f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:19.867103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 862/1725] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:19 2022] PUT /identity/v3/projects/3a3cb5326a6c417db2de3e46abb770f1/users/44cd6ec1a2bc424cab1258c32ad38285/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:19.868990 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:19.869331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:19.869713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:19.877717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 864/1726] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:19.883076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a1ce6-a314-4132-a556-dfed1bcc6f1f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:19.903613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:19.905145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:19.910577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a1ce6-a314-4132-a556-dfed1bcc6f1f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:19.994418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 863/1727] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:20:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:19.997383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:20.000202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:20.068329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:20.069386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:20.069527 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:20.069845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:20.070718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:20.072391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:20.085517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 865/1728] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:20.089562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:20.107440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eda2d8-03cb-4380-b50a-94c3d3bb6d03 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:20.113751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fdc69-811e-44ef-9f3d-6cd2879d6ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:20.114832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fdc69-811e-44ef-9f3d-6cd2879d6ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:20.115120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fdc69-811e-44ef-9f3d-6cd2879d6ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:20.115408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fdc69-811e-44ef-9f3d-6cd2879d6ae0 admin admin] PATH_INFO: `/v3/projects/3a3cb5326a6c417db2de3e46abb770f1/users/44cd6ec1a2bc424cab1258c32ad38285/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:20.117839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fdc69-811e-44ef-9f3d-6cd2879d6ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3cb5326a6c417db2de3e46abb770f1, user_id=44cd6ec1a2bc424cab1258c32ad38285, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:20.120884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fdc69-811e-44ef-9f3d-6cd2879d6ae0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:20.136054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 866/1729] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:20 2022] PUT /identity/v3/projects/3a3cb5326a6c417db2de3e46abb770f1/users/44cd6ec1a2bc424cab1258c32ad38285/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:20.140333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aee49-1efb-40d6-8be6-fa0ba93be9e1 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:20.148585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:20.148997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:20.149387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:20.231655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] MFA Rules not processed for user `44cd6ec1a2bc424cab1258c32ad38285`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:20.234506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:20.270639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:20.272430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:20.272862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:20.273460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:20.430056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:20.431656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:20.445259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 867/1730] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:20.457379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 864/1731] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:20.525163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:20.527261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:20.598115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b644c-81d5-48d9-ab5c-e18157985d6d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:20.604367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:20.605350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:20.605883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:20.607183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:20.640495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:20.648091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:20.659158 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:20.660767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:20.674905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 868/1732] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:20:20.761146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8ed63-bfd7-4cac-925a-dbac8a1da0fb service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:20.766920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:20.767932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:20.768372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:20.769045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:20.850607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:20.856630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:20.883691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 865/1733] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:20:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:20:21.044218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:21.045946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:21.075947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f79299-9b95-4260-8509-6f6697a39fe0 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:21.081394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad21f-09e5-4a15-8b4d-ee28cfe23350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:21.082511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad21f-09e5-4a15-8b4d-ee28cfe23350 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:21.083015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad21f-09e5-4a15-8b4d-ee28cfe23350 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:21.083509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad21f-09e5-4a15-8b4d-ee28cfe23350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:21.093678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1d2ad21f-09e5-4a15-8b4d-ee28cfe23350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:21.248475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad21f-09e5-4a15-8b4d-ee28cfe23350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:21.250197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad21f-09e5-4a15-8b4d-ee28cfe23350 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:21.280560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 869/1734] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:21.369597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:21.374448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:21.421112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b110b3-1f58-4f19-8747-280fffe8e018 service swift] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:21.436402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:21.437398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:21.437704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:21.437982 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] PATH_INFO: `/v3/projects/f38d7eefd888465a8a7cc60361612d26` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:21.439724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38d7eefd888465a8a7cc60361612d26)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:21.441767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:21.620987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38d7eefd888465a8a7cc60361612d26', 'request_id': 'req-837c0b3c-7ba6-4549-bc16-731542c84832'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:21.699315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729203af-5035-414a-8abd-311dea43bc0f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:21.700378 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729203af-5035-414a-8abd-311dea43bc0f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:21.701872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729203af-5035-414a-8abd-311dea43bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:21.733872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38d7eefd888465a8a7cc60361612d26', 'request_id': 'req-837c0b3c-7ba6-4549-bc16-731542c84832'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:21.744735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38d7eefd888465a8a7cc60361612d26', 'request_id': 'req-837c0b3c-7ba6-4549-bc16-731542c84832'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:21.813845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-729203af-5035-414a-8abd-311dea43bc0f None None] MFA Rules not processed for user `f4629fa2f6874eb2a6adb2f0dc59c8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:21.816122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] The token cache is being invalidate because project f38d7eefd888465a8a7cc60361612d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:21.819931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-729203af-5035-414a-8abd-311dea43bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:21.821952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:21.822822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:21.831467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 866/1735] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:21 2022] DELETE /identity/v3/projects/f38d7eefd888465a8a7cc60361612d26 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:21.834547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:21.835904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:22.075536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 870/1736] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:22.080796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729203af-5035-414a-8abd-311dea43bc0f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:22.090367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-729203af-5035-414a-8abd-311dea43bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:22.157149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c0b3c-7ba6-4549-bc16-731542c84832 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:22.179920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:22.185187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:22.185485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:22.185789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] PATH_INFO: `/v3/users/3ade88226a12486798cc8e3752ae5937` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:22.195905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ade88226a12486798cc8e3752ae5937)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:22.198676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:22.355629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729203af-5035-414a-8abd-311dea43bc0f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:22.377070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5763dd-9042-4f37-9de7-77203dd2d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:22.377070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5763dd-9042-4f37-9de7-77203dd2d9ed admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:22.377070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5763dd-9042-4f37-9de7-77203dd2d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:22.377070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5763dd-9042-4f37-9de7-77203dd2d9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:22.377504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5763dd-9042-4f37-9de7-77203dd2d9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:22.378349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5763dd-9042-4f37-9de7-77203dd2d9ed admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:22.476817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ade88226a12486798cc8e3752ae5937'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:22.478321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ade88226a12486798cc8e3752ae5937'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:22.508360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ade88226a12486798cc8e3752ae5937'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:22.509629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ade88226a12486798cc8e3752ae5937'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:22.518849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ade88226a12486798cc8e3752ae5937'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:22.528947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 871/1737] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:22 2022] POST /identity/v3/projects => generated 403 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:20:22.530544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc8ba-7261-4e93-8a17-86a19593e9a5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:22.530650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc8ba-7261-4e93-8a17-86a19593e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:22.530978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc8ba-7261-4e93-8a17-86a19593e9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:22.585496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-135bc8ba-7261-4e93-8a17-86a19593e9a5 None None] MFA Rules not processed for user `9b842d30b55c48bf8f375bdcc829bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:22.587108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-135bc8ba-7261-4e93-8a17-86a19593e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:22.630893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 867/1738] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:21 2022] DELETE /identity/v3/users/3ade88226a12486798cc8e3752ae5937 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:22.633515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:22.645621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:22.759337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 872/1739] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Feb 16 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:22.764080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:22.764381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:22.764663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:22.777200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9315cd-e7d4-4961-9677-8abae61ee556 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:22.787584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:22.788541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:22.789040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:22.789537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:22.790972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:22.795755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:22.866332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] MFA Rules not processed for user `9463920d27f94ad688f3850e88795c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:22.866332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:22.920761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 873/1740] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:22.922127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:22.924385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:23.057593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951726d0-2455-4646-866d-502fa32f2f80 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:23.063302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:23.064823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:23.065186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:23.065572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:23.102389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:23.102389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:23.106934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 874/1741] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:23.228837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 868/1742] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:22 2022] POST /identity/v3/users => generated 308 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:23.230276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:23.276777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4afc-eae7-438f-82d2-5ab97469f842 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:23.284182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:23.285137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:23.285584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:23.286013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:23.287336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:23.290038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:23.339876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:23.340284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 875/1743] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:23.378347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba3737-2b42-45b9-b9a4-3fb6c5cbc1e0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:23.402042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:23.403320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:23.403788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:23.404249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] PATH_INFO: `/v3/projects/53d99edb58c84524a8d1eff266e29222/users/e6fc85491f95428cb99d7848ffa62450/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:23.440678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d99edb58c84524a8d1eff266e29222, user_id=e6fc85491f95428cb99d7848ffa62450, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:23.445332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:23.602661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 869/1744] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:23 2022] PUT /identity/v3/projects/53d99edb58c84524a8d1eff266e29222/users/e6fc85491f95428cb99d7848ffa62450/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:23.607130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:23.631733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb95ce-113c-48a6-aae1-a104392476e5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:23.643221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:23.645587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:23.789481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ef206-6512-4975-8bfb-20d0cbe19531 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:23.794377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:23.795735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:23.796260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:23.796784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:23.800253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:23.815711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:23.817283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:23.817875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:23.818236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:23.819573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:23.823462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:23.850487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 876/1745] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:23.852344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:23.855159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:23.873393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec83325-7cfd-4d75-8c43-e527adc46cb3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:23.884261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:23.887161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:23.888749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:23.888994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:23.889467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] PATH_INFO: `/v3/projects/bb986b5e3d034b6bb4bec125bb4c81d8` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:23.890454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:23.894312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb986b5e3d034b6bb4bec125bb4c81d8)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:23.899590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:23.935981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 870/1746] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:20:23.936686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:23.978883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff17cf-8c0a-44b5-813f-9dc2d62e37fa service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:24.012830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beb9d7-cccd-423f-9f18-74ddf975629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:24.018470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb9d7-cccd-423f-9f18-74ddf975629c admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:24.019336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb9d7-cccd-423f-9f18-74ddf975629c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:24.019738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beb9d7-cccd-423f-9f18-74ddf975629c admin admin] PATH_INFO: `/v3/projects/53d99edb58c84524a8d1eff266e29222/users/e6fc85491f95428cb99d7848ffa62450/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:24.032132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beb9d7-cccd-423f-9f18-74ddf975629c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d99edb58c84524a8d1eff266e29222, user_id=e6fc85491f95428cb99d7848ffa62450, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:24.038753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beb9d7-cccd-423f-9f18-74ddf975629c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:24.083875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 871/1747] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:23 2022] PUT /identity/v3/projects/53d99edb58c84524a8d1eff266e29222/users/e6fc85491f95428cb99d7848ffa62450/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:24.115245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb986b5e3d034b6bb4bec125bb4c81d8', 'request_id': 'req-d5412396-e43a-4cc5-aa99-d553aae13481'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:24.225098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb986b5e3d034b6bb4bec125bb4c81d8', 'request_id': 'req-d5412396-e43a-4cc5-aa99-d553aae13481'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:24.233354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb986b5e3d034b6bb4bec125bb4c81d8', 'request_id': 'req-d5412396-e43a-4cc5-aa99-d553aae13481'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:24.259241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] The token cache is being invalidate because project bb986b5e3d034b6bb4bec125bb4c81d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:24.259522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:24.260624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d5412396-e43a-4cc5-aa99-d553aae13481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:24.262966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 877/1748] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:23 2022] DELETE /identity/v3/projects/bb986b5e3d034b6bb4bec125bb4c81d8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:24.271978 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6212-e945-4a17-a5fd-773455a16752 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:24.273049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6212-e945-4a17-a5fd-773455a16752 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:24.275017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6212-e945-4a17-a5fd-773455a16752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:24.347735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8c8a6212-e945-4a17-a5fd-773455a16752 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:24.349597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8c8a6212-e945-4a17-a5fd-773455a16752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:24.578012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 872/1749] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:24.588643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e311c3-b781-4695-8909-02b518564dfc None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:24.589659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e311c3-b781-4695-8909-02b518564dfc None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:24.590001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e311c3-b781-4695-8909-02b518564dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:24.634115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-02e311c3-b781-4695-8909-02b518564dfc None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:24.635365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-02e311c3-b781-4695-8909-02b518564dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:24.674266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 878/1750] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:24.677489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6212-e945-4a17-a5fd-773455a16752 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:24.718073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6212-e945-4a17-a5fd-773455a16752 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:24.738720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:24.739693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:24.740128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:24.742593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:24.743953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:24.744474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:24.753478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:24.795105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 873/1751] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:24.796323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e311c3-b781-4695-8909-02b518564dfc None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:24.811234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e311c3-b781-4695-8909-02b518564dfc None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:24.833937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:24.837057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:24.840593 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:24.841061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:24.841951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:24.846338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:25.000416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 879/1752] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:24 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:25.005216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:25.015857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6804ab-5264-4dfd-8ed0-e38158bb3567 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:25.263774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:25.265923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:25.266427 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:25.267289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:25.268215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:25.270691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:25.406489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 874/1753] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:25 2022] POST /identity/v3/users => generated 290 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:25.411356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:25.426722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b7c12-4546-4060-9f9b-68ddc4787ba5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:25.446064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e9d89-406e-44a6-b850-2230a2249cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:25.447088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e9d89-406e-44a6-b850-2230a2249cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:25.447547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e9d89-406e-44a6-b850-2230a2249cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:25.448013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e9d89-406e-44a6-b850-2230a2249cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:25.448929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e9d89-406e-44a6-b850-2230a2249cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:25.451324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e9d89-406e-44a6-b850-2230a2249cfa admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:25.465288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 880/1754] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:25.469193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:25.482402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13841958-7fe5-4bd8-99aa-2a34368b8aa0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:25.498984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:25.499933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:25.500419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:25.501564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:25.502720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:25.504879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:25.511538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0daa-1995-4e95-b56c-0f9d063a060a None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:25.511921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0daa-1995-4e95-b56c-0f9d063a060a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:25.512276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0daa-1995-4e95-b56c-0f9d063a060a None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:25.516400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 881/1755] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:20:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:20:25.528973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:25.529899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:25.529899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:25.543923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 875/1756] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:25.546320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:25.576144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:25.577397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:25.590715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5c81f-839d-4b89-94d0-1861b4b38c4a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:25.608146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb4a87-d610-4170-8bc1-2a741e74a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:25.610785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb4a87-d610-4170-8bc1-2a741e74a571 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:25.610785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb4a87-d610-4170-8bc1-2a741e74a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:25.610785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb4a87-d610-4170-8bc1-2a741e74a571 admin admin] PATH_INFO: `/v3/projects/cab183235bea4b648b43e74df8e1a9f4/users/224c547cc73e4532974715f82cdb4cf2/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:25.672574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb4a87-d610-4170-8bc1-2a741e74a571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab183235bea4b648b43e74df8e1a9f4, user_id=224c547cc73e4532974715f82cdb4cf2, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:25.683922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb4a87-d610-4170-8bc1-2a741e74a571 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:25.744346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 882/1757] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:25.760424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:25.763103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:25.789127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 876/1758] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:25 2022] PUT /identity/v3/projects/cab183235bea4b648b43e74df8e1a9f4/users/224c547cc73e4532974715f82cdb4cf2/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:25.797111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ce35-e260-4684-9bf7-eb0fac946d63 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:25.797496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ce35-e260-4684-9bf7-eb0fac946d63 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:25.798540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ce35-e260-4684-9bf7-eb0fac946d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:25.811779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98be2-c689-4668-9a48-10607eee7f68 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:25.850409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4df2ce35-e260-4684-9bf7-eb0fac946d63 None None] MFA Rules not processed for user `224c547cc73e4532974715f82cdb4cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:25.852150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4df2ce35-e260-4684-9bf7-eb0fac946d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:26.000553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 877/1759] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:26.005748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ce35-e260-4684-9bf7-eb0fac946d63 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:26.027557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:26.029239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:26.029671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:26.030265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:26.041720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:26.043694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:26.057114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 883/1760] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:26.165548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ce35-e260-4684-9bf7-eb0fac946d63 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:26.199221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:26.200255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:26.201255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:26.201406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:26.203334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:26.241700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:26.263017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:26.265437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:26.287202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802f61-3199-479a-912a-c5eaf9344095 service nova] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:26.309927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:26.310946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:26.311139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:26.311418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] PATH_INFO: `/v3/users/48afc15bf0414686ac03d34a90f1f00f` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:26.320895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48afc15bf0414686ac03d34a90f1f00f)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:26.322921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:26.442562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 878/1761] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:26 2022] POST /identity/v3/projects => generated 381 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:26.450796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:26.588367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ba85-363a-40d3-a65c-eb39a5f9d8a3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:26.594209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:26.595481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:26.595838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:26.596195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:26.597579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:26.599650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:26.664339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48afc15bf0414686ac03d34a90f1f00f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:26.666670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48afc15bf0414686ac03d34a90f1f00f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:26.686482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48afc15bf0414686ac03d34a90f1f00f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:26.703432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 879/1762] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:26 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:26.708946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:26.712217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:26.733500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391aab-3624-4d4a-b7e3-46f4dbd56785 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:26.733816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48afc15bf0414686ac03d34a90f1f00f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:26.735239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48afc15bf0414686ac03d34a90f1f00f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:26.740804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca8243-1b65-4070-9962-896f49f52c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:26.741935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8243-1b65-4070-9962-896f49f52c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:26.742396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8243-1b65-4070-9962-896f49f52c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:26.742908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca8243-1b65-4070-9962-896f49f52c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:26.744085 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8243-1b65-4070-9962-896f49f52c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:26.748103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca8243-1b65-4070-9962-896f49f52c4a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:26.796343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 880/1763] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:26.804998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacfbb9-ecf3-490f-ac46-70e67d73ce5e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:26.805412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacfbb9-ecf3-490f-ac46-70e67d73ce5e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:26.806252 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacfbb9-ecf3-490f-ac46-70e67d73ce5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:26.855301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6bacfbb9-ecf3-490f-ac46-70e67d73ce5e None None] MFA Rules not processed for user `e6fc85491f95428cb99d7848ffa62450`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:26.856651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6bacfbb9-ecf3-490f-ac46-70e67d73ce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:26.857969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 884/1764] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:26 2022] DELETE /identity/v3/users/48afc15bf0414686ac03d34a90f1f00f => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:26.859368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:26.994504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 881/1765] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:27.005761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:27.005761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:27.005761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:27.026892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:27.028328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:27.028825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33278ed1-7af1-48f2-b27c-da26b9072d26 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:27.037673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:27.038797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:27.039265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:27.039766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] PATH_INFO: `/v3/projects/40443a7371d248e4ba0ba16bd2bec876/users/229d9278e8d34415ad26331e4694ff33/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:27.042167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 882/1766] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:27.062362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:27.066053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:27.091772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40443a7371d248e4ba0ba16bd2bec876, user_id=229d9278e8d34415ad26331e4694ff33, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:27.104701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:27.216384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dce84-7e71-45ed-9fb5-b2e2a73058e5 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:27.231016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 885/1767] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:26 2022] PUT /identity/v3/projects/40443a7371d248e4ba0ba16bd2bec876/users/229d9278e8d34415ad26331e4694ff33/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:27.234523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:27.351114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec57a2-b18b-46f3-8924-03d80363fc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:27.351787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec57a2-b18b-46f3-8924-03d80363fc54 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:27.352550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec57a2-b18b-46f3-8924-03d80363fc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:27.353014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec57a2-b18b-46f3-8924-03d80363fc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:27.442160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f83872-5ff1-48aa-81c4-3c89b6d53193 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:27.456020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:27.458903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:27.458903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:27.458903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:27.458903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:27.460821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:27.475389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 886/1768] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:27.481617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:27.498927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec57a2-b18b-46f3-8924-03d80363fc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:27.500374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec57a2-b18b-46f3-8924-03d80363fc54 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:27.512686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900436-4296-4bd7-aed3-9b717bf457a5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:27.535312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:27.535534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 883/1769] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:27.535622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:27.535622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:27.535622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] PATH_INFO: `/v3/projects/40443a7371d248e4ba0ba16bd2bec876/users/229d9278e8d34415ad26331e4694ff33/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:27.554280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40443a7371d248e4ba0ba16bd2bec876, user_id=229d9278e8d34415ad26331e4694ff33, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:27.572234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:27.603468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 887/1770] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:27 2022] PUT /identity/v3/projects/40443a7371d248e4ba0ba16bd2bec876/users/229d9278e8d34415ad26331e4694ff33/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:27.606146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:27.606367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:27.606666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:27.656786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] MFA Rules not processed for user `229d9278e8d34415ad26331e4694ff33`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:27.662879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:27.782918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 884/1771] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:28.905799 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:28.909380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:29.044734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501b84-380b-465f-a2a6-e9cde2620fb3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:29.058987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:29.060406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:29.061046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:29.061681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] PATH_INFO: `/v3/projects/ba56aa01fe9742c88c5ce8ff243dbe69` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:29.063189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba56aa01fe9742c88c5ce8ff243dbe69)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:29.066388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:29.241573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba56aa01fe9742c88c5ce8ff243dbe69', 'request_id': 'req-5f259795-cef2-42af-8790-adf8078d3cdf'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.311277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba56aa01fe9742c88c5ce8ff243dbe69', 'request_id': 'req-5f259795-cef2-42af-8790-adf8078d3cdf'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.322730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba56aa01fe9742c88c5ce8ff243dbe69', 'request_id': 'req-5f259795-cef2-42af-8790-adf8078d3cdf'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.323491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:29.326494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:29.339894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] The token cache is being invalidate because project ba56aa01fe9742c88c5ce8ff243dbe69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:29.340443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.347443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5f259795-cef2-42af-8790-adf8078d3cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.354038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 888/1772] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:28 2022] DELETE /identity/v3/projects/ba56aa01fe9742c88c5ce8ff243dbe69 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:29.357543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a573b-dbca-41a9-8d67-89b732b0828a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:29.358057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a573b-dbca-41a9-8d67-89b732b0828a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:29.358497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a573b-dbca-41a9-8d67-89b732b0828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:29.379209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6061fbd-1b59-4b94-b88e-12479be45f2b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:29.413469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-411a573b-dbca-41a9-8d67-89b732b0828a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:29.414693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-411a573b-dbca-41a9-8d67-89b732b0828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:29.549264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:29.550736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:29.551728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:29.552175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] PATH_INFO: `/v3/users/404dcdea3de34c01893427dea87449ff` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:29.562270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404dcdea3de34c01893427dea87449ff)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:29.562270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:29.583385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 889/1773] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:29.592326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0d49-559a-4e38-8be9-02a5d3964f87 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:29.592672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0d49-559a-4e38-8be9-02a5d3964f87 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:29.592951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0d49-559a-4e38-8be9-02a5d3964f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:29.664152 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f61a0d49-559a-4e38-8be9-02a5d3964f87 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:29.669309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f61a0d49-559a-4e38-8be9-02a5d3964f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:29.690640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 890/1774] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:29.698805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0d49-559a-4e38-8be9-02a5d3964f87 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:29.731829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0d49-559a-4e38-8be9-02a5d3964f87 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:29.743701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:29.745423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:29.746014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:29.746618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:29.747543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:29.754898 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:29.762574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:29.797318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 891/1775] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:29.803101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:29.827860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb61ac-16a4-422f-b8a8-71c691b4d36c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:29.874917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:29.879317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:29.880046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:29.880638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:29.882241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404dcdea3de34c01893427dea87449ff'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.883334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:29.883837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404dcdea3de34c01893427dea87449ff'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.886411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:29.945975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404dcdea3de34c01893427dea87449ff'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.946865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404dcdea3de34c01893427dea87449ff'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:29.972100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2a845323-5550-424f-b834-ad0cac14cf42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404dcdea3de34c01893427dea87449ff'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:30.051352 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 892/1776] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:29 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:30.058672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:30.062320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:30.109977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 885/1777] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:29 2022] DELETE /identity/v3/users/404dcdea3de34c01893427dea87449ff => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:30.118547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:30.119029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:30.119446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:30.198657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:30.200767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:30.331229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f47ca4-8484-4ee2-9297-32c6ee916127 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:30.414213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 886/1778] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:30.415800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:30.420508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:30.479459 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:30.480597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:30.481050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:30.481258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:30.482170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:30.485368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:30.535044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26b1f-362f-465e-b9e9-79ab47292fad None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:30.543586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:30.544284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:30.544574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:30.544833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:30.547026 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:30.569240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 893/1779] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:30 2022] POST /identity/v3/users => generated 286 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:30.570577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:30.573642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:30.607074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e524-7921-4767-97f0-7516d19ff520 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:30.630505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:30.632478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:30.634039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:30.635244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] PATH_INFO: `/v3/users/c07c36b66f8443378c775a1963be4574` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:30.638754 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07c36b66f8443378c775a1963be4574)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:30.645184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:30.685661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:30.687808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:30.704657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 887/1780] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:30.706226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:30.708445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:30.827332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e91858-60c5-4b39-a884-a0a525bc0a00 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:30.833926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:30.833926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:30.834596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:30.835018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:30.852250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:30.854632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:30.882940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 888/1781] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:30.887261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:30.889416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07c36b66f8443378c775a1963be4574'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:30.890872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07c36b66f8443378c775a1963be4574'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:30.911167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07c36b66f8443378c775a1963be4574'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:30.912680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10608c74-8168-4114-b651-e98e72f52b2c service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:30.923560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:30.926441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:30.929872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:30.929872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:30.929872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:30.929872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:30.938064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07c36b66f8443378c775a1963be4574'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:30.942907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07c36b66f8443378c775a1963be4574'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:30.954572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 889/1782] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:30.955721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:30.957642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:30.982034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4bdad-de30-4fe3-b76d-64aa9697b9ec admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:30.993558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:30.993558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:30.993558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:30.993558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] PATH_INFO: `/v3/users/f4629fa2f6874eb2a6adb2f0dc59c8a7` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:31.003907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4629fa2f6874eb2a6adb2f0dc59c8a7)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:31.007687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:31.054857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 894/1783] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:30 2022] DELETE /identity/v3/users/c07c36b66f8443378c775a1963be4574 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:31.055911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:31.057518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:31.216746 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e93c-ef61-44df-913b-92ac6a1cc3b8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:31.226012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5bc81-ec7c-4a07-b056-a4190dcf3332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:31.226808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bc81-ec7c-4a07-b056-a4190dcf3332 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:31.227188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bc81-ec7c-4a07-b056-a4190dcf3332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:31.227573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5bc81-ec7c-4a07-b056-a4190dcf3332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:31.228480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5bc81-ec7c-4a07-b056-a4190dcf3332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:31.231411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5bc81-ec7c-4a07-b056-a4190dcf3332 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:31.246717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 895/1784] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:31.246717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b79d2-aec4-4fb2-9408-54c8958e5b8a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:31.246717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b79d2-aec4-4fb2-9408-54c8958e5b8a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:31.246717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b79d2-aec4-4fb2-9408-54c8958e5b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:31.282357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1e1b79d2-aec4-4fb2-9408-54c8958e5b8a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:31.284676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1e1b79d2-aec4-4fb2-9408-54c8958e5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:31.307382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 896/1785] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:31.311183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b79d2-aec4-4fb2-9408-54c8958e5b8a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:31.321302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4629fa2f6874eb2a6adb2f0dc59c8a7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:31.322627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4629fa2f6874eb2a6adb2f0dc59c8a7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:31.337775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4629fa2f6874eb2a6adb2f0dc59c8a7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:31.338500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4629fa2f6874eb2a6adb2f0dc59c8a7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:31.338819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b79d2-aec4-4fb2-9408-54c8958e5b8a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:31.347598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4629fa2f6874eb2a6adb2f0dc59c8a7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:31.357438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427af025-d2b0-4d08-b881-68a8039e4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:31.358449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af025-d2b0-4d08-b881-68a8039e4dce admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:31.359283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af025-d2b0-4d08-b881-68a8039e4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:31.364203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427af025-d2b0-4d08-b881-68a8039e4dce admin admin] PATH_INFO: `/v3/projects/b97dd29137ee441295d7bd43ffab7c84/users/2a97782988d146c9b7bb93801f6f18fb/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:31.389870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427af025-d2b0-4d08-b881-68a8039e4dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97dd29137ee441295d7bd43ffab7c84, user_id=2a97782988d146c9b7bb93801f6f18fb, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:31.397597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427af025-d2b0-4d08-b881-68a8039e4dce admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:31.481703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 890/1786] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:30 2022] DELETE /identity/v3/users/f4629fa2f6874eb2a6adb2f0dc59c8a7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:31.483469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:31.486786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:31.534230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 897/1787] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:31 2022] PUT /identity/v3/projects/b97dd29137ee441295d7bd43ffab7c84/users/2a97782988d146c9b7bb93801f6f18fb/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:31.536604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:31.537003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:31.538724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:31.576835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] MFA Rules not processed for user `2a97782988d146c9b7bb93801f6f18fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:31.578375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:31.638628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9db1f3-5c75-4c74-9fcb-992e06057793 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:31.720592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 898/1788] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:31.729156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:31.732351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:31.801394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:31.802284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:31.802664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:31.803128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:31.805399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:31.950723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b0530-2786-4fa7-9f5c-56a71781fbf8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:31.972388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:31.973217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:31.973332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:31.973843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:31.974488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:31.977258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:32.039037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:32.043926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:32.094098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 899/1789] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:31 2022] POST /identity/v3/projects => generated 373 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:32.094098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:32.095331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 891/1790] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:32.096357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:32.097857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:32.131126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861e366-4664-4661-a68f-75446db887a1 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:32.291122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e0ac-5135-48ba-bb58-5630193a8c2f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:32.297386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:32.305163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:32.306021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:32.306653 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:32.308365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:32.316087 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:32.321555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:32.324820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:32.325528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:32.325813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] PATH_INFO: `/v3/projects/3ddf88c40913456187b7cc79b5f50ca6` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:32.331198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddf88c40913456187b7cc79b5f50ca6)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:32.334024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:32.463225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 892/1791] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:32 2022] POST /identity/v3/users => generated 293 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:32.464451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:32.467755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:32.509765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddf88c40913456187b7cc79b5f50ca6', 'request_id': 'req-e43895d7-0872-4e7e-a2d3-1c24b2719e04'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:32.569371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddf88c40913456187b7cc79b5f50ca6', 'request_id': 'req-e43895d7-0872-4e7e-a2d3-1c24b2719e04'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:32.593537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddf88c40913456187b7cc79b5f50ca6', 'request_id': 'req-e43895d7-0872-4e7e-a2d3-1c24b2719e04'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:32.603943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688e229-8cd2-4357-9266-32d5a6550c00 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:32.631620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] The token cache is being invalidate because project 3ddf88c40913456187b7cc79b5f50ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:32.631620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:32.637284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:32.654985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 900/1792] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:32 2022] DELETE /identity/v3/projects/3ddf88c40913456187b7cc79b5f50ca6 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:32.656039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:32.660988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:32.703574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229d9278e8d34415ad26331e4694ff33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40443a7371d248e4ba0ba16bd2bec876', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:32.704929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:32.705420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:32.705715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:32.706496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:32.710576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:32.710576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:32.728247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 893/1793] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:32.729587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:32.733723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:32.820684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43895d7-0872-4e7e-a2d3-1c24b2719e04 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:32.833907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:32.834950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:32.835127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:32.835580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] PATH_INFO: `/v3/projects/c9c036e4fd0541dda19c8bbe71a97a39` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:32.838477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c036e4fd0541dda19c8bbe71a97a39)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:32.845595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:32.859163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298d632-46a8-44bb-9064-151934049b7f tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:32.870081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:32.870903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:32.871159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:32.871531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:32.872231 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:32.874279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:32.903715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 894/1794] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:32.905017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:32.910399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:32.936079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b5967-28d9-4c7a-98f6-c52bb523eabb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:32.943013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:32.944047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:32.944336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:32.944680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] PATH_INFO: `/v3/users/44cd6ec1a2bc424cab1258c32ad38285` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:32.947386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cd6ec1a2bc424cab1258c32ad38285)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:32.949826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:33.018201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c036e4fd0541dda19c8bbe71a97a39', 'request_id': 'req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.094479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c036e4fd0541dda19c8bbe71a97a39', 'request_id': 'req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.103392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c036e4fd0541dda19c8bbe71a97a39', 'request_id': 'req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.121198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] The token cache is being invalidate because project c9c036e4fd0541dda19c8bbe71a97a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:33.121198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.121198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.122145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 901/1795] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:32 2022] DELETE /identity/v3/projects/c9c036e4fd0541dda19c8bbe71a97a39 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:33.123126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:33.124542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:33.155869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cd6ec1a2bc424cab1258c32ad38285'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.156538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cd6ec1a2bc424cab1258c32ad38285'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.189733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cd6ec1a2bc424cab1258c32ad38285'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.190592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cd6ec1a2bc424cab1258c32ad38285'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.210794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cd6ec1a2bc424cab1258c32ad38285'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.261388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c7953-f67c-4289-99a7-2c18a54aa1f0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:33.267494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229d9278e8d34415ad26331e4694ff33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40443a7371d248e4ba0ba16bd2bec876', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:33.268190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:33.268480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:33.268759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:33.269505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:33.271507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:33.287039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 895/1796] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:32 2022] DELETE /identity/v3/users/44cd6ec1a2bc424cab1258c32ad38285 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:33.287039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:33.293710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:33.410659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 902/1797] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:33 2022] POST /identity/v3/projects => generated 355 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:33.411550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:33.416244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:33.434736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3dada-681c-4f5c-9d84-c88519a5c892 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:33.522220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:33.523919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:33.524434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:33.525539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] PATH_INFO: `/v3/projects/dc74de4b4ba94655a59ef071f44c893b/users/78946e82f17348dc83458e86c27326b7/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:33.558621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c25c1-e0f2-4169-8aa5-7a8edfdfe206 tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:33.572495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:33.581887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc74de4b4ba94655a59ef071f44c893b, user_id=78946e82f17348dc83458e86c27326b7, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:33.586874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:33.608050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:33.608050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:33.608050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] PATH_INFO: `/v3/projects/2718f4cc73ec4c7f8eca8f0c81e8ca36` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:33.608050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2718f4cc73ec4c7f8eca8f0c81e8ca36)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:33.608050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:33.724276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 896/1798] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:33 2022] PUT /identity/v3/projects/dc74de4b4ba94655a59ef071f44c893b/users/78946e82f17348dc83458e86c27326b7/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:33.725791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:33.730680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:33.815786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2718f4cc73ec4c7f8eca8f0c81e8ca36', 'request_id': 'req-85731a91-2462-4761-b0b6-d8b843d02858'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.886706 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2718f4cc73ec4c7f8eca8f0c81e8ca36', 'request_id': 'req-85731a91-2462-4761-b0b6-d8b843d02858'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.896984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2718f4cc73ec4c7f8eca8f0c81e8ca36', 'request_id': 'req-85731a91-2462-4761-b0b6-d8b843d02858'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.946091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] The token cache is being invalidate because project 2718f4cc73ec4c7f8eca8f0c81e8ca36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:33.946450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.949661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:33.959996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 903/1799] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:33 2022] DELETE /identity/v3/projects/2718f4cc73ec4c7f8eca8f0c81e8ca36 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:33.961011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:33.964578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f8489-d9f1-4243-a9f4-a3c2cf561bbe admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:33.972881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:34.115351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:34.115925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:34.116273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:34.116690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] PATH_INFO: `/v3/users/e6fc85491f95428cb99d7848ffa62450` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:34.118661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fc85491f95428cb99d7848ffa62450)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:34.139774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:34.163468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85731a91-2462-4761-b0b6-d8b843d02858 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:34.168282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229d9278e8d34415ad26331e4694ff33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40443a7371d248e4ba0ba16bd2bec876', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:34.168970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:34.169302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:34.169893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:34.170353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:34.170630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:34.172258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:34.193456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 904/1800] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:34.194414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:34.196250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:34.212463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974529e7-537a-4744-947f-56be88c33fde tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:34.217520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:34.218204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:34.218503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:34.220501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:34.220501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:34.221631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:34.233186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 905/1801] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:34.234020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:34.235835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:34.251387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5a24a-cede-48de-9d64-d41860147774 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:34.256327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:34.257249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:34.257543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:34.257820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] PATH_INFO: `/v3/users/39ef7efc62d54fc1b5b9f140232e2095` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:34.259040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ef7efc62d54fc1b5b9f140232e2095)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:34.260967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:34.570110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ef7efc62d54fc1b5b9f140232e2095'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.570816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ef7efc62d54fc1b5b9f140232e2095'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.580404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ef7efc62d54fc1b5b9f140232e2095'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.586296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fc85491f95428cb99d7848ffa62450'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.587576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fc85491f95428cb99d7848ffa62450'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.599227 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ef7efc62d54fc1b5b9f140232e2095'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.600241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ef7efc62d54fc1b5b9f140232e2095'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.623379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fc85491f95428cb99d7848ffa62450'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.626482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fc85491f95428cb99d7848ffa62450'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.639261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fc85491f95428cb99d7848ffa62450'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:34.684597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 906/1802] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:34 2022] DELETE /identity/v3/users/39ef7efc62d54fc1b5b9f140232e2095 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:34.684597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:34.685369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:34.747230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 897/1803] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:33 2022] DELETE /identity/v3/users/e6fc85491f95428cb99d7848ffa62450 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:34.748219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:34.752421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:34.777523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761434-e9b4-4ffc-b6c4-94144ab2c471 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:34.834004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c97fe-e5a2-4afa-92e0-7a56ec519137 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:34.839950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '229d9278e8d34415ad26331e4694ff33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40443a7371d248e4ba0ba16bd2bec876', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:34.841029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:34.841526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:34.841654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] PATH_INFO: `/v3/projects/0353a8bb898045ac8b10421da6edb419` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:34.842900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0353a8bb898045ac8b10421da6edb419)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:34.845428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:34.859409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:34.860504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:34.860914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:34.861240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] PATH_INFO: `/v3/projects/dc74de4b4ba94655a59ef071f44c893b/users/78946e82f17348dc83458e86c27326b7/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:34.863659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc74de4b4ba94655a59ef071f44c893b, user_id=78946e82f17348dc83458e86c27326b7, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:34.866382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:34.878907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 907/1804] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:34 2022] PUT /identity/v3/projects/dc74de4b4ba94655a59ef071f44c893b/users/78946e82f17348dc83458e86c27326b7/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:34.882335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:34.890099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:34.973293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bb65e-ebef-4962-9b2e-56d5fd0e6dba admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:34.983958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:34.985335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:34.986559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:34.986891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] PATH_INFO: `/v3/projects/3a3cb5326a6c417db2de3e46abb770f1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:34.988724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3cb5326a6c417db2de3e46abb770f1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:34.990901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:34.996056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0353a8bb898045ac8b10421da6edb419', 'request_id': 'req-5bb74276-f904-48c1-b5d0-a909a7e045bb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.066816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0353a8bb898045ac8b10421da6edb419', 'request_id': 'req-5bb74276-f904-48c1-b5d0-a909a7e045bb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.077175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0353a8bb898045ac8b10421da6edb419', 'request_id': 'req-5bb74276-f904-48c1-b5d0-a909a7e045bb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.095316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] The token cache is being invalidate because project 0353a8bb898045ac8b10421da6edb419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:35.095626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.096305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5bb74276-f904-48c1-b5d0-a909a7e045bb tempest-VolumeQuotaClassesTest-1391115204 tempest-VolumeQuotaClassesTest-1391115204-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.105851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 898/1805] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:34 2022] DELETE /identity/v3/projects/0353a8bb898045ac8b10421da6edb419 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:35.105851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.105851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.105851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.129159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3cb5326a6c417db2de3e46abb770f1', 'request_id': 'req-54b8d937-904b-4be9-a13f-0d580959059a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.156964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] MFA Rules not processed for user `78946e82f17348dc83458e86c27326b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:35.158411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.202904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3cb5326a6c417db2de3e46abb770f1', 'request_id': 'req-54b8d937-904b-4be9-a13f-0d580959059a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.211280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3cb5326a6c417db2de3e46abb770f1', 'request_id': 'req-54b8d937-904b-4be9-a13f-0d580959059a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.230320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] The token cache is being invalidate because project 3a3cb5326a6c417db2de3e46abb770f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:35.230517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.231281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54b8d937-904b-4be9-a13f-0d580959059a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.233765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 908/1806] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:34 2022] DELETE /identity/v3/projects/3a3cb5326a6c417db2de3e46abb770f1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:35.239450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b48c8-f14d-4a39-a221-c657e3f8f6de None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.239450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b48c8-f14d-4a39-a221-c657e3f8f6de None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.239663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b48c8-f14d-4a39-a221-c657e3f8f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.254022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 899/1807] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:35.262245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.266130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.269357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-840b48c8-f14d-4a39-a221-c657e3f8f6de None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:35.270936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-840b48c8-f14d-4a39-a221-c657e3f8f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.337876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6f1fb-418e-43a1-a1bf-1f58f09c2fb3 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:35.347781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 909/1808] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:35.349046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:35.349758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ae027-4b7b-43a3-aadc-bc6d9f6abd0b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.350020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.350118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ae027-4b7b-43a3-aadc-bc6d9f6abd0b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.350354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ae027-4b7b-43a3-aadc-bc6d9f6abd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.351197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.352314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.354734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.369890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:35.372931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-304ae027-4b7b-43a3-aadc-bc6d9f6abd0b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:35.373873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:35.374286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-304ae027-4b7b-43a3-aadc-bc6d9f6abd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.384095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 910/1809] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:35.390477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ae027-4b7b-43a3-aadc-bc6d9f6abd0b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.394318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 900/1810] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:35.399444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ae027-4b7b-43a3-aadc-bc6d9f6abd0b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:35.405820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:35.406684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.406969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.407505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.408356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:35.408661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:35.410337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:35.422535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 911/1811] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:35.427698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.439219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825607e-a85f-449c-8df8-2a46d86aa690 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:35.444283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:35.445290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.445582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.445866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.446572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:35.448500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:35.508399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.510307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.538099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb747b5a-47a6-44c0-9ed5-99f7df8c8f84 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:35.551383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:35.552279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.552567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.552865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] PATH_INFO: `/v3/projects/53d99edb58c84524a8d1eff266e29222` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.554890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d99edb58c84524a8d1eff266e29222)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:35.565385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:35.578793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 901/1812] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:35 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:35.583995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.696919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c823a-5157-4db7-9400-17d75ef07480 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:35.703197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:35.705411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.705836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.706190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.707057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:35.709539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:35.752155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d99edb58c84524a8d1eff266e29222', 'request_id': 'req-6f3f829d-c7ad-4861-ba30-c218c12a2145'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.808402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 902/1813] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:35 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:20:35.809232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.814956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.822909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d99edb58c84524a8d1eff266e29222', 'request_id': 'req-6f3f829d-c7ad-4861-ba30-c218c12a2145'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.829470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d99edb58c84524a8d1eff266e29222', 'request_id': 'req-6f3f829d-c7ad-4861-ba30-c218c12a2145'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.839657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987904bc-2127-4e2d-91ff-a4b4c9815882 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:35.851844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] The token cache is being invalidate because project 53d99edb58c84524a8d1eff266e29222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:35.852218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.852942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:35.854978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 912/1814] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:35 2022] DELETE /identity/v3/projects/53d99edb58c84524a8d1eff266e29222 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:35.855837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.857565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.929833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:35.930719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.931020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.931359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] PATH_INFO: `/v3/projects/92d63ad9a87b454cb289a0b4c52b3e43` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.932703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d63ad9a87b454cb289a0b4c52b3e43)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:35.934660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:35.942183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f829d-c7ad-4861-ba30-c218c12a2145 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:35.948190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceeb1e-438d-40f0-85ab-0f28544cc492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:35.948190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceeb1e-438d-40f0-85ab-0f28544cc492 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.948190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceeb1e-438d-40f0-85ab-0f28544cc492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.948453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceeb1e-438d-40f0-85ab-0f28544cc492 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.949327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceeb1e-438d-40f0-85ab-0f28544cc492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:35.951221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceeb1e-438d-40f0-85ab-0f28544cc492 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:35.963422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 913/1815] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:35.964760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:35.965054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:35.965359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:35.987538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:35.988839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:35.997117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 914/1816] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:35.997941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:35.999215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.012019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df375b-2463-4ace-ad03-91eb0e963e27 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:36.017753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:36.018603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.018865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.019140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] PATH_INFO: `/v3/users/224c547cc73e4532974715f82cdb4cf2` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.020366 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=224c547cc73e4532974715f82cdb4cf2)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:36.022312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:36.043787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d63ad9a87b454cb289a0b4c52b3e43', 'request_id': 'req-dbb4e722-bf34-4352-9508-6ca09debf5fd'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.145505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d63ad9a87b454cb289a0b4c52b3e43', 'request_id': 'req-dbb4e722-bf34-4352-9508-6ca09debf5fd'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.153954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d63ad9a87b454cb289a0b4c52b3e43', 'request_id': 'req-dbb4e722-bf34-4352-9508-6ca09debf5fd'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.167850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] The token cache is being invalidate because project 92d63ad9a87b454cb289a0b4c52b3e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:36.168151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.169539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.171919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 903/1817] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:35 2022] DELETE /identity/v3/projects/92d63ad9a87b454cb289a0b4c52b3e43 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:36.174323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:36.180274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.227021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224c547cc73e4532974715f82cdb4cf2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.227756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224c547cc73e4532974715f82cdb4cf2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.239383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224c547cc73e4532974715f82cdb4cf2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.251947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4e722-bf34-4352-9508-6ca09debf5fd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:36.254473 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224c547cc73e4532974715f82cdb4cf2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.255217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224c547cc73e4532974715f82cdb4cf2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.256885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19760ef0-7794-46b5-95e1-82fba3ee3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:36.257598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760ef0-7794-46b5-95e1-82fba3ee3124 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.259364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760ef0-7794-46b5-95e1-82fba3ee3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.259364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19760ef0-7794-46b5-95e1-82fba3ee3124 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.259364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19760ef0-7794-46b5-95e1-82fba3ee3124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:36.260457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19760ef0-7794-46b5-95e1-82fba3ee3124 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:36.271298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 904/1818] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:36.272680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.272972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.273282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.292709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:36.296027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.302998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 905/1819] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:36.303923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:36.307321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.321102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fa92c-d26e-4651-b15c-c5d14a5aab2d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:36.326861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:36.327737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.328020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.328292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] PATH_INFO: `/v3/users/fa0b2c814945400892d5ff2b35fd320b` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.329769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0b2c814945400892d5ff2b35fd320b)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:36.331682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:36.351050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 915/1820] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:35 2022] DELETE /identity/v3/users/224c547cc73e4532974715f82cdb4cf2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:36.352364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:36.353862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.419432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f8232-d4e0-4fe4-b49d-57fe795e2556 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:36.427702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfd0a8-f944-4a13-bd3b-e477b2d36970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:36.428941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfd0a8-f944-4a13-bd3b-e477b2d36970 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.429302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfd0a8-f944-4a13-bd3b-e477b2d36970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.429586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfd0a8-f944-4a13-bd3b-e477b2d36970 admin admin] PATH_INFO: `/v3/projects/758fa08d0973408d8d8c5ccbc8e02516/users/ef7b48b8d06c43b3a3f929666f36ca98/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.446806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfd0a8-f944-4a13-bd3b-e477b2d36970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758fa08d0973408d8d8c5ccbc8e02516, user_id=ef7b48b8d06c43b3a3f929666f36ca98, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:36.449848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfd0a8-f944-4a13-bd3b-e477b2d36970 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:36.491757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0b2c814945400892d5ff2b35fd320b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.492436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0b2c814945400892d5ff2b35fd320b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.507055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0b2c814945400892d5ff2b35fd320b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.507055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0b2c814945400892d5ff2b35fd320b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.514585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0b2c814945400892d5ff2b35fd320b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.598870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 906/1821] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:36 2022] DELETE /identity/v3/users/fa0b2c814945400892d5ff2b35fd320b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:36.598870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:36.599249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 916/1822] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:36 2022] PUT /identity/v3/projects/758fa08d0973408d8d8c5ccbc8e02516/users/ef7b48b8d06c43b3a3f929666f36ca98/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:36.599249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16807b-4d02-4a70-823b-19c23d2c1f61 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.599249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16807b-4d02-4a70-823b-19c23d2c1f61 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.599249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16807b-4d02-4a70-823b-19c23d2c1f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.599501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.630358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ce16807b-4d02-4a70-823b-19c23d2c1f61 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:36.632626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ce16807b-4d02-4a70-823b-19c23d2c1f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.680740 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957788-92d6-4e35-8f5a-1ed3b54b404d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:36.685642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:36.686323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.686607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.686891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.687735 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:36.688044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:36.690821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:36.705534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 907/1823] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:36.706447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:36.708225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.721122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 917/1824] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:36.721122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1f25-6289-4125-b425-6b14fd59bc7f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.721122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1f25-6289-4125-b425-6b14fd59bc7f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.721122 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1f25-6289-4125-b425-6b14fd59bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.724882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9777e-ff79-447d-a4ef-e1090d6286ff admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:36.734639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:36.735948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.736401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.736822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] PATH_INFO: `/v3/users/2a97782988d146c9b7bb93801f6f18fb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.738370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a97782988d146c9b7bb93801f6f18fb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:36.740645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:36.750719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b30d1f25-6289-4125-b425-6b14fd59bc7f None None] MFA Rules not processed for user `ef7b48b8d06c43b3a3f929666f36ca98`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:36.752742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b30d1f25-6289-4125-b425-6b14fd59bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.819911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 918/1825] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:36.820902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1f25-6289-4125-b425-6b14fd59bc7f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:36.835532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1f25-6289-4125-b425-6b14fd59bc7f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:36.840398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:36.841068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:36.841435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:36.841714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:36.842586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:36.845313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:36.942576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a97782988d146c9b7bb93801f6f18fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.944095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a97782988d146c9b7bb93801f6f18fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.948421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 919/1826] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:36 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:36.949667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:36.952132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:36.968559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a97782988d146c9b7bb93801f6f18fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.970754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a97782988d146c9b7bb93801f6f18fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:36.978358 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a97782988d146c9b7bb93801f6f18fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:37.025311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d36b8f-c00a-4218-b4a9-a3431d7aa4b0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.029368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.030023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.030312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.030591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.033522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.054303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 908/1827] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:36 2022] DELETE /identity/v3/users/2a97782988d146c9b7bb93801f6f18fb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:37.059149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.059149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.112700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.112700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.122857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 920/1828] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:37.126143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.129708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.145821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec231da-3458-481d-a50d-ffd44ce02f32 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.151295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5835bc7-484e-432a-9428-d022008000bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.151979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5835bc7-484e-432a-9428-d022008000bf admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.153011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5835bc7-484e-432a-9428-d022008000bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.153288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5835bc7-484e-432a-9428-d022008000bf admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.153928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ee0ad-b79f-4213-a47c-6c992ef6a805 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.154082 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5835bc7-484e-432a-9428-d022008000bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.155964 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5835bc7-484e-432a-9428-d022008000bf admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.160674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.161764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.162056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.162348 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.163126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.167830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.248455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 921/1829] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:37 2022] POST /identity/v3/users => generated 279 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:37.251406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9785e4-2db9-4eb2-b3e6-e5a510eb8810 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.252045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9785e4-2db9-4eb2-b3e6-e5a510eb8810 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.253193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9785e4-2db9-4eb2-b3e6-e5a510eb8810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.277978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2a9785e4-2db9-4eb2-b3e6-e5a510eb8810 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:37.280627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2a9785e4-2db9-4eb2-b3e6-e5a510eb8810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.283867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 909/1830] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:37 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:37.284749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.295006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.376665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 922/1831] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:37.377586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9785e4-2db9-4eb2-b3e6-e5a510eb8810 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.383010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b2b4a-857a-4a7d-8337-6c158d505d36 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.388910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9785e4-2db9-4eb2-b3e6-e5a510eb8810 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.389054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.389173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.389413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.389691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] PATH_INFO: `/v3/projects/74366a46ad694b5790aae9a21e2d29a4` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.390848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] RBAC: Authorizing `identity:delete_project(project_id=74366a46ad694b5790aae9a21e2d29a4)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.392861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.393136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.393812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.394092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.394540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.395262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.396855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.413130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 923/1832] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:37.413130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.421393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710c927-505f-405a-8c51-b5af714131fb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.427461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.428169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.428457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.428734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.429525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.431477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.495365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74366a46ad694b5790aae9a21e2d29a4', 'request_id': 'req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:37.499297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 924/1833] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:37 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:37.503163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.505417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.566561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74366a46ad694b5790aae9a21e2d29a4', 'request_id': 'req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:37.568293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908680e0-5e94-4587-abf4-28c7ef5fa577 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.575531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74366a46ad694b5790aae9a21e2d29a4', 'request_id': 'req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:37.589217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] The token cache is being invalidate because project 74366a46ad694b5790aae9a21e2d29a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:37.589507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:37.590813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:37.593160 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 910/1834] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:37 2022] DELETE /identity/v3/projects/74366a46ad694b5790aae9a21e2d29a4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:37.597536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.597536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.628589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257b734-e3ca-4672-a73f-f4722e3b5ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.629284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257b734-e3ca-4672-a73f-f4722e3b5ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.629737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257b734-e3ca-4672-a73f-f4722e3b5ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.630018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257b734-e3ca-4672-a73f-f4722e3b5ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.632677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b257b734-e3ca-4672-a73f-f4722e3b5ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.675713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d954-2285-47bc-bbd2-bbaf99cb90be admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.681639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.683281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.683651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.683967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.684716 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.686759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.699994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 911/1835] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:37.701556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.703446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.717604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486d761-fdbd-45c5-a1e2-776c8cf24f68 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.723798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257b734-e3ca-4672-a73f-f4722e3b5ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.724012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.724694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.724986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.725295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257b734-e3ca-4672-a73f-f4722e3b5ae4 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.725391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.726153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.727759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.735654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 925/1836] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:37.737036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d098b0f-11ea-4ff8-b6bc-9b012eeda21d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.737534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d098b0f-11ea-4ff8-b6bc-9b012eeda21d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.737785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d098b0f-11ea-4ff8-b6bc-9b012eeda21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.743278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 912/1837] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:37.744701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.747369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.760769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7d098b0f-11ea-4ff8-b6bc-9b012eeda21d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:37.762662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7d098b0f-11ea-4ff8-b6bc-9b012eeda21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:37.768573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c4cbb-1b1e-44ce-954c-0a6cef37f0b6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.788039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 926/1838] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:37.788157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.788347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d098b0f-11ea-4ff8-b6bc-9b012eeda21d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.788422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.788422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.788422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] PATH_INFO: `/v3/projects/cab183235bea4b648b43e74df8e1a9f4` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.794789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab183235bea4b648b43e74df8e1a9f4)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.798734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.802387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d098b0f-11ea-4ff8-b6bc-9b012eeda21d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:37.810026 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:37.810974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:37.811264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:37.811544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] PATH_INFO: `/v3/projects/ed90722d6bfa4645b4543437cc5d8513/users/bc7ae0c2411a42719506632ca438ee56/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:37.833430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed90722d6bfa4645b4543437cc5d8513, user_id=bc7ae0c2411a42719506632ca438ee56, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:37.839437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:37.905824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 927/1839] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:37 2022] PUT /identity/v3/projects/ed90722d6bfa4645b4543437cc5d8513/users/bc7ae0c2411a42719506632ca438ee56/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:37.915336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab183235bea4b648b43e74df8e1a9f4', 'request_id': 'req-7a45110a-3e51-4841-a381-dd698ddf439d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:37.915630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:37.984760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01664bb8-0ac5-4f3b-87e6-448626323cc9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.019362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab183235bea4b648b43e74df8e1a9f4', 'request_id': 'req-7a45110a-3e51-4841-a381-dd698ddf439d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.026993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab183235bea4b648b43e74df8e1a9f4', 'request_id': 'req-7a45110a-3e51-4841-a381-dd698ddf439d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.044797 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] The token cache is being invalidate because project cab183235bea4b648b43e74df8e1a9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:38.045134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.045810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a45110a-3e51-4841-a381-dd698ddf439d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.047928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 913/1840] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:37 2022] DELETE /identity/v3/projects/cab183235bea4b648b43e74df8e1a9f4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:38.049631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2c4a-fd2f-4c6d-a31b-99eb28506183 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.049924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2c4a-fd2f-4c6d-a31b-99eb28506183 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.050202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b2c4a-fd2f-4c6d-a31b-99eb28506183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.064422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.065491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.065775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.066054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] PATH_INFO: `/v3/projects/327084a367e147cd924bb03d6172e43a/users/89b0d75e332d4c28b429671772206ba7/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.077715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b19b2c4a-fd2f-4c6d-a31b-99eb28506183 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:38.079877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b19b2c4a-fd2f-4c6d-a31b-99eb28506183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.085768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327084a367e147cd924bb03d6172e43a, user_id=89b0d75e332d4c28b429671772206ba7, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.088999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.093334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 914/1841] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:38.095311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6392c5-0dc3-4bd0-8bdb-cea03be4ee42 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.095611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6392c5-0dc3-4bd0-8bdb-cea03be4ee42 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.095890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6392c5-0dc3-4bd0-8bdb-cea03be4ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.126449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ab6392c5-0dc3-4bd0-8bdb-cea03be4ee42 None None] MFA Rules not processed for user `bc7ae0c2411a42719506632ca438ee56`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:38.127624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ab6392c5-0dc3-4bd0-8bdb-cea03be4ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.208191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 928/1842] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:37 2022] PUT /identity/v3/projects/327084a367e147cd924bb03d6172e43a/users/89b0d75e332d4c28b429671772206ba7/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:38.209434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.211160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.219753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 915/1843] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:38.221132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6392c5-0dc3-4bd0-8bdb-cea03be4ee42 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.234327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6392c5-0dc3-4bd0-8bdb-cea03be4ee42 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.300616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6462d-04be-4130-930b-127ad7b21ff2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.307030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.307915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.308290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.308506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] PATH_INFO: `/v3/users/229d9278e8d34415ad26331e4694ff33` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.309755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] RBAC: Authorizing `identity:delete_user(user_id=229d9278e8d34415ad26331e4694ff33)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.311967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.322734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.323774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.324458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.325005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.326615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:38.327183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.329911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.341693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 916/1844] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:38.342676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.344516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.356623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216f42-2346-4a4c-a5f7-0e4f97267a6b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.361888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.362539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.362822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.363099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.363808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.365416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.375371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 917/1845] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:38.377178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.378928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.392627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c529fe3-a81b-4bf7-8fff-639ffdf5362a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.397518 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.402253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.402253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.402253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.402253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.402253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.466544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229d9278e8d34415ad26331e4694ff33'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.467249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229d9278e8d34415ad26331e4694ff33'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.474826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229d9278e8d34415ad26331e4694ff33'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.486905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 918/1846] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:38 2022] POST /identity/v3/projects => generated 357 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:38.487759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.489474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229d9278e8d34415ad26331e4694ff33'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.489608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.490357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229d9278e8d34415ad26331e4694ff33'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.538724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 929/1847] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:38 2022] DELETE /identity/v3/users/229d9278e8d34415ad26331e4694ff33 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:38.542591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.544358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.557658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55206d0-0546-4b58-af0e-808daa67d694 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.619930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae4e9-f0e5-4435-9284-858780c9bedd admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.625142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769792c-3663-430e-b640-3298757f359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.625390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.626552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769792c-3663-430e-b640-3298757f359b admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.627066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769792c-3663-430e-b640-3298757f359b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.627583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769792c-3663-430e-b640-3298757f359b admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.627700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.627791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.628062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] PATH_INFO: `/v3/projects/b97dd29137ee441295d7bd43ffab7c84` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.628206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769792c-3663-430e-b640-3298757f359b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.630063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97dd29137ee441295d7bd43ffab7c84)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.630574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769792c-3663-430e-b640-3298757f359b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.632001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.746418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 930/1848] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:38 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:38.746418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769792c-3663-430e-b640-3298757f359b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.746418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d769792c-3663-430e-b640-3298757f359b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.776126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97dd29137ee441295d7bd43ffab7c84', 'request_id': 'req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.819608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769792c-3663-430e-b640-3298757f359b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:38.837656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97dd29137ee441295d7bd43ffab7c84', 'request_id': 'req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.849855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97dd29137ee441295d7bd43ffab7c84', 'request_id': 'req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.892024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:38.893711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] The token cache is being invalidate because project b97dd29137ee441295d7bd43ffab7c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:38.894002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:38.894730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:38.894969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] PATH_INFO: `/v3/projects/327084a367e147cd924bb03d6172e43a/users/89b0d75e332d4c28b429671772206ba7/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:38.901273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.901408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=327084a367e147cd924bb03d6172e43a, user_id=89b0d75e332d4c28b429671772206ba7, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:38.901408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:38.908528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:38.912140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 931/1849] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:38 2022] PUT /identity/v3/projects/327084a367e147cd924bb03d6172e43a/users/89b0d75e332d4c28b429671772206ba7/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:38.912956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.917175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 919/1850] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:38 2022] DELETE /identity/v3/projects/b97dd29137ee441295d7bd43ffab7c84 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:38.917308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.917804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:38.922265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:38.944679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d5d36-0169-48bd-9ff6-ed74d275dfa8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:39.025162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:39.026512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:39.026944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:39.027394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:39.028234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:39.030611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:39.034017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6aae4c-280a-4be3-b13e-f8ab76649cbe admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:39.041512 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790b1bd-ac96-4bf1-8d10-14aef499eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:39.042430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b1bd-ac96-4bf1-8d10-14aef499eaec admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:39.042720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b1bd-ac96-4bf1-8d10-14aef499eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:39.043005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790b1bd-ac96-4bf1-8d10-14aef499eaec admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:39.043707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790b1bd-ac96-4bf1-8d10-14aef499eaec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:39.046259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790b1bd-ac96-4bf1-8d10-14aef499eaec admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:39.130447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 920/1851] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:38 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:39.131604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:39.136472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:39.141255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 932/1852] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:38 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:39.141255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:39.141255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:39.141255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:39.158401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba6853-b12e-44c9-87f6-f05e867eef8f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:39.166536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:39.166536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:39.166536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:39.166536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] PATH_INFO: `/v3/users/78946e82f17348dc83458e86c27326b7` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:39.168459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78946e82f17348dc83458e86c27326b7)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:39.170430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:39.170737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] MFA Rules not processed for user `89b0d75e332d4c28b429671772206ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:39.171950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:39.247347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 933/1853] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:39.248253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:39.249661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:39.264997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd16216-4dd2-4bf0-8c56-8bfaca7b8dbf None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:39.270508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:39.271393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:39.271657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:39.271923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] PATH_INFO: `/v3/projects/40443a7371d248e4ba0ba16bd2bec876` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:39.273160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=40443a7371d248e4ba0ba16bd2bec876)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:39.275096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.226068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40443a7371d248e4ba0ba16bd2bec876', 'request_id': 'req-50c32814-db5d-42bd-956e-bdb751d261ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.228456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78946e82f17348dc83458e86c27326b7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.229664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78946e82f17348dc83458e86c27326b7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.242664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78946e82f17348dc83458e86c27326b7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.243506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78946e82f17348dc83458e86c27326b7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.252829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78946e82f17348dc83458e86c27326b7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.310176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40443a7371d248e4ba0ba16bd2bec876', 'request_id': 'req-50c32814-db5d-42bd-956e-bdb751d261ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.319819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40443a7371d248e4ba0ba16bd2bec876', 'request_id': 'req-50c32814-db5d-42bd-956e-bdb751d261ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.337255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] The token cache is being invalidate because project 40443a7371d248e4ba0ba16bd2bec876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:40.337833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.338521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:40.340115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 934/1854] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:39 2022] DELETE /identity/v3/projects/40443a7371d248e4ba0ba16bd2bec876 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:40.341924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.344015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:40.440565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c32814-db5d-42bd-956e-bdb751d261ef admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.440761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 921/1855] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:39 2022] DELETE /identity/v3/users/78946e82f17348dc83458e86c27326b7 => generated 0 bytes in 1306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:40.440761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.440761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:40.442129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.442902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.443223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.443501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.444325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.445993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.461807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 935/1856] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:40.463611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.467145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:40.530310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4775ec-8ed4-4fcf-9fab-b75e916fb5e8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.536849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d2b99-6456-49f3-aa89-0639a171cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.537818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2b99-6456-49f3-aa89-0639a171cfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.538383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2b99-6456-49f3-aa89-0639a171cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.538851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d2b99-6456-49f3-aa89-0639a171cfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.539773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d2b99-6456-49f3-aa89-0639a171cfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.541619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d2b99-6456-49f3-aa89-0639a171cfc3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.554591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1345-4c03-4517-9c4c-1c7532cba165 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.556729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 922/1857] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:40.558452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073437-3bdd-4e12-a4ae-5f8e74f6dbd6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.558847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073437-3bdd-4e12-a4ae-5f8e74f6dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.559205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0073437-3bdd-4e12-a4ae-5f8e74f6dbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.592050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f0073437-3bdd-4e12-a4ae-5f8e74f6dbd6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:40.592887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f0073437-3bdd-4e12-a4ae-5f8e74f6dbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:40.605844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 923/1858] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:40.607609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0073437-3bdd-4e12-a4ae-5f8e74f6dbd6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.627402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0073437-3bdd-4e12-a4ae-5f8e74f6dbd6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.632944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.633668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.633952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.634228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.634959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.636615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.639927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639f9cc-e398-4164-b7eb-f0a712713cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.640632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f9cc-e398-4164-b7eb-f0a712713cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.640954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f9cc-e398-4164-b7eb-f0a712713cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.641267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639f9cc-e398-4164-b7eb-f0a712713cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.646280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e639f9cc-e398-4164-b7eb-f0a712713cc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:40.650948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 924/1859] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:40.651866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.654241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:40.673609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0256d0d-be1c-4e6e-a094-00f7cc8500e5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.679908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.681362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.681882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.682404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] PATH_INFO: `/v3/projects/9e0bd4ddaabc45b1843611a2e1b94fe1/users/6b7d5f996fbc423eaa3688ef6a98d5d9/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.700566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0bd4ddaabc45b1843611a2e1b94fe1, user_id=6b7d5f996fbc423eaa3688ef6a98d5d9, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.703552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.740282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f9cc-e398-4164-b7eb-f0a712713cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.742000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639f9cc-e398-4164-b7eb-f0a712713cc7 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.753849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 936/1860] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:40.756171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb03c-1919-4362-b02b-272d89179b1c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.756534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb03c-1919-4362-b02b-272d89179b1c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.761007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb03c-1919-4362-b02b-272d89179b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.776873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a6bbb03c-1919-4362-b02b-272d89179b1c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:40.778121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a6bbb03c-1919-4362-b02b-272d89179b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:40.790565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 925/1861] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:40 2022] PUT /identity/v3/projects/9e0bd4ddaabc45b1843611a2e1b94fe1/users/6b7d5f996fbc423eaa3688ef6a98d5d9/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:40.796923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.888419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 937/1862] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:40.889433 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbb03c-1919-4362-b02b-272d89179b1c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.907722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbb03c-1919-4362-b02b-272d89179b1c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.917837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.918536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.918808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.923348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.923348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.923630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.926571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7a37f-7ac7-445d-a8bd-c17ebaf3c9df admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.933983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322178e6-d1a4-485c-87b6-bb001f185d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.934700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 938/1863] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:40.935644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.935768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322178e6-d1a4-485c-87b6-bb001f185d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.936406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322178e6-d1a4-485c-87b6-bb001f185d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.937413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322178e6-d1a4-485c-87b6-bb001f185d0e admin admin] PATH_INFO: `/v3/projects/4ae14c10b27f4ac19b2ea58c553dc15c/users/bc86986053134a06a19320cc05df4037/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.948284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb28e-13f3-4402-8354-8d2c1c2e3a5d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:40.958892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:40.959583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:40.959870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:40.960150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:40.960883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:40.961224 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.962982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.973310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322178e6-d1a4-485c-87b6-bb001f185d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae14c10b27f4ac19b2ea58c553dc15c, user_id=bc86986053134a06a19320cc05df4037, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:40.976554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322178e6-d1a4-485c-87b6-bb001f185d0e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:40.982901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 939/1864] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:40.983866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:40.994983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527eba1-ec7f-4dce-ab8e-848e2b038282 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.000321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.001563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.001922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.002268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] PATH_INFO: `/v3/projects/9e0bd4ddaabc45b1843611a2e1b94fe1/users/6b7d5f996fbc423eaa3688ef6a98d5d9/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.004343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0bd4ddaabc45b1843611a2e1b94fe1, user_id=6b7d5f996fbc423eaa3688ef6a98d5d9, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:41.007119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:41.018655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 940/1865] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:40 2022] PUT /identity/v3/projects/9e0bd4ddaabc45b1843611a2e1b94fe1/users/6b7d5f996fbc423eaa3688ef6a98d5d9/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:41.019492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:41.054857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 926/1866] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:40 2022] PUT /identity/v3/projects/4ae14c10b27f4ac19b2ea58c553dc15c/users/bc86986053134a06a19320cc05df4037/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:41.056318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab21c4-242c-4fd2-9276-2495187c739c None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.056618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab21c4-242c-4fd2-9276-2495187c739c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.056899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab21c4-242c-4fd2-9276-2495187c739c None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.058967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 927/1867] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:20:41.059580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab21c4-242c-4fd2-9276-2495187c739c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:41.078660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d297b-71b0-44ec-873b-e7dbfe3b6390 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.140181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9790a-3e46-4422-b155-9c06287c68ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.141195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9790a-3e46-4422-b155-9c06287c68ba service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.141815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9790a-3e46-4422-b155-9c06287c68ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.142399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9790a-3e46-4422-b155-9c06287c68ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.144439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9ab9790a-3e46-4422-b155-9c06287c68ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.160947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab21c4-242c-4fd2-9276-2495187c739c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.165992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8e42d-bb39-4629-92a5-9770d8b8dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.166774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8e42d-bb39-4629-92a5-9770d8b8dc30 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.167133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8e42d-bb39-4629-92a5-9770d8b8dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.167483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8e42d-bb39-4629-92a5-9770d8b8dc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.168251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8e42d-bb39-4629-92a5-9770d8b8dc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:41.170416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8e42d-bb39-4629-92a5-9770d8b8dc30 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:41.214182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9790a-3e46-4422-b155-9c06287c68ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:41.218391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9790a-3e46-4422-b155-9c06287c68ba service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:41.227884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 941/1868] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:41.229289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.229609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.229892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.260006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] MFA Rules not processed for user `6b7d5f996fbc423eaa3688ef6a98d5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:41.262969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.264277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 928/1869] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:41 2022] POST /identity/v3/projects => generated 359 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:41.265664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81b7c2-a808-45a3-8ad5-1f853147e673 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.265963 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81b7c2-a808-45a3-8ad5-1f853147e673 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.266249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81b7c2-a808-45a3-8ad5-1f853147e673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.302434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7c81b7c2-a808-45a3-8ad5-1f853147e673 None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:41.303768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7c81b7c2-a808-45a3-8ad5-1f853147e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.387195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 929/1870] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:41.389294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d541bf-4340-4e87-87e0-af2f9f2effc7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.389753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d541bf-4340-4e87-87e0-af2f9f2effc7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.390040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d541bf-4340-4e87-87e0-af2f9f2effc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.391597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 942/1871] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:41.391972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:41.393567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.434740 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-10d541bf-4340-4e87-87e0-af2f9f2effc7 None None] MFA Rules not processed for user `bc86986053134a06a19320cc05df4037`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:41.435993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-10d541bf-4340-4e87-87e0-af2f9f2effc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.530857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85f2c0-cfbb-4297-b1f4-0b6c0f48e708 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.536220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.537132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.537431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.537761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] PATH_INFO: `/v3/projects/dc74de4b4ba94655a59ef071f44c893b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.539063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc74de4b4ba94655a59ef071f44c893b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:41.541030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:41.565762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 930/1872] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:41.566728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d541bf-4340-4e87-87e0-af2f9f2effc7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:41.591391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d541bf-4340-4e87-87e0-af2f9f2effc7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.596588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.597396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.597696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.597959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.598661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:41.600857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:41.666743 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc74de4b4ba94655a59ef071f44c893b', 'request_id': 'req-a8e6328a-c1a3-4a20-8e49-543c211482a2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:41.685787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 931/1873] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:41 2022] POST /identity/v3/users => generated 280 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:41.685787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:41.685787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.709920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455477fd-3478-4c01-87c6-9ef6d45a5e04 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.733400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc74de4b4ba94655a59ef071f44c893b', 'request_id': 'req-a8e6328a-c1a3-4a20-8e49-543c211482a2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:41.740547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc74de4b4ba94655a59ef071f44c893b', 'request_id': 'req-a8e6328a-c1a3-4a20-8e49-543c211482a2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:41.752761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] The token cache is being invalidate because project dc74de4b4ba94655a59ef071f44c893b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:41.753058 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:41.756071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:41.756071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 943/1874] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:41 2022] DELETE /identity/v3/projects/dc74de4b4ba94655a59ef071f44c893b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:41.756470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:41.758406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.784130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.799876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.799876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.799876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.799876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.804204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:41.809787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:41.821668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 932/1875] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:41.822489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:41.823847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.879487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6328a-c1a3-4a20-8e49-543c211482a2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.893761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.894920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.895571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.895926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.902977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:41.928616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d600-0dee-4ab5-a2a1-fc2e7265f38d service nova] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:41.939278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212cb1e-7582-433b-98dc-fe49ffbef7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:41.940579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cb1e-7582-433b-98dc-fe49ffbef7ac admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:41.941134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cb1e-7582-433b-98dc-fe49ffbef7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:41.941825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cb1e-7582-433b-98dc-fe49ffbef7ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:41.944418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212cb1e-7582-433b-98dc-fe49ffbef7ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:41.947428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212cb1e-7582-433b-98dc-fe49ffbef7ac admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.027187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.030276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.050138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 944/1876] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:41 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:42.051868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.053324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.056544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 933/1877] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:41 2022] POST /identity/v3/projects => generated 393 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:42.059201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.059903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.060440 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.070428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35fc5f-1b8e-4df9-85e3-1f4535b3ac37 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.098503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:42.099897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.154892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.155723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.156007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.156281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.157040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.159301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.172304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 945/1878] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:42.172478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 934/1879] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:42.172555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.172702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.174135 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.183060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9995-5f2e-43f7-a936-381d9484bf55 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.190125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693362ae-738a-4362-97f2-27b2c0c93cf9 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.190624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc0811-114d-4398-8892-1106948ee99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.191540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc0811-114d-4398-8892-1106948ee99c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.191888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc0811-114d-4398-8892-1106948ee99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.192228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc0811-114d-4398-8892-1106948ee99c admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.192978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc0811-114d-4398-8892-1106948ee99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.196066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc0811-114d-4398-8892-1106948ee99c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.207238 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.208375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.208566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.209029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] PATH_INFO: `/v3/users/ef7b48b8d06c43b3a3f929666f36ca98` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.210316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7b48b8d06c43b3a3f929666f36ca98)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.212531 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.329446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 946/1880] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:42 2022] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:42.330268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff0c7-a616-4536-b30c-57c1fe367b60 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.330569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff0c7-a616-4536-b30c-57c1fe367b60 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.330857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff0c7-a616-4536-b30c-57c1fe367b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.349725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-308ff0c7-a616-4536-b30c-57c1fe367b60 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:42.350946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-308ff0c7-a616-4536-b30c-57c1fe367b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.359305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 947/1881] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:42.360917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff0c7-a616-4536-b30c-57c1fe367b60 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.370462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff0c7-a616-4536-b30c-57c1fe367b60 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.375782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.377008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.377329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.377595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.378354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.379940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.390187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 948/1882] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:42.391130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.413277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7b48b8d06c43b3a3f929666f36ca98'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:42.414282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7b48b8d06c43b3a3f929666f36ca98'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:42.432008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7b48b8d06c43b3a3f929666f36ca98'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:42.432720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7b48b8d06c43b3a3f929666f36ca98'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:42.440170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7b48b8d06c43b3a3f929666f36ca98'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:42.448738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c0045-e7cd-419b-81b7-124c3b07266b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.453270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.454812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.455445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.455734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.457613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.517859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 935/1883] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:42 2022] DELETE /identity/v3/users/ef7b48b8d06c43b3a3f929666f36ca98 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:42.519011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.520556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.524254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.525936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.536876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 949/1884] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:42.537706 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.539351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.553934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49329-7043-4065-a674-b26a6c85bb47 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.588554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14760f1-8d21-4bfe-9ccb-d949758b0d1b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.593465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.594138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.594451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.594743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.595511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.597128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.610628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 936/1885] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:42.610628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.612307 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.613612 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea4a57-a615-41f3-ac5e-87a232a09bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.614278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea4a57-a615-41f3-ac5e-87a232a09bae admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.614560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea4a57-a615-41f3-ac5e-87a232a09bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.614836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea4a57-a615-41f3-ac5e-87a232a09bae admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.615557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea4a57-a615-41f3-ac5e-87a232a09bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:42.615863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea4a57-a615-41f3-ac5e-87a232a09bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.617480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea4a57-a615-41f3-ac5e-87a232a09bae admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.625035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d731c-06eb-40c0-b4b3-35a216b5744f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.630038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 950/1886] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:42.631310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24331-a0f1-4c67-99a3-1f31d589ffc0 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.631606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24331-a0f1-4c67-99a3-1f31d589ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.631882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b24331-a0f1-4c67-99a3-1f31d589ffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.635240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.636734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.637413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.637921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] PATH_INFO: `/v3/projects/a734056d5c504d6ebe2800c66cf06cf7/users/e0f11f7caa424bc09460dee94ebba6d2/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.650256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d9b24331-a0f1-4c67-99a3-1f31d589ffc0 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:42.651469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d9b24331-a0f1-4c67-99a3-1f31d589ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.656760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a734056d5c504d6ebe2800c66cf06cf7, user_id=e0f11f7caa424bc09460dee94ebba6d2, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.659241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 951/1887] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:42.659733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.659828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24331-a0f1-4c67-99a3-1f31d589ffc0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.670217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b24331-a0f1-4c67-99a3-1f31d589ffc0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.675664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.676550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.676828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.677136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] PATH_INFO: `/v3/projects/f616db9d61104e8b8719c1e2649032b6/users/835e4c30c6554a7ca98b66b141e217dc/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.692271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f616db9d61104e8b8719c1e2649032b6, user_id=835e4c30c6554a7ca98b66b141e217dc, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.695129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.722529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 937/1888] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:42 2022] PUT /identity/v3/projects/a734056d5c504d6ebe2800c66cf06cf7/users/e0f11f7caa424bc09460dee94ebba6d2/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:42.723349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.756725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 952/1889] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:42 2022] PUT /identity/v3/projects/f616db9d61104e8b8719c1e2649032b6/users/835e4c30c6554a7ca98b66b141e217dc/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:42.757524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.759097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:42.791654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d864b48-6d85-4d22-afdf-098cd95c6222 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.826676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ab43e-ade8-4369-9ddf-f46bda290c57 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:42.831617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe50f83-ae7d-4b88-b80f-48ad0c1d8a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.832597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe50f83-ae7d-4b88-b80f-48ad0c1d8a88 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.832597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe50f83-ae7d-4b88-b80f-48ad0c1d8a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.832863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe50f83-ae7d-4b88-b80f-48ad0c1d8a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.861014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:42.861881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.862367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.862680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.863405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.865544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.911010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe50f83-ae7d-4b88-b80f-48ad0c1d8a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:42.912515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe50f83-ae7d-4b88-b80f-48ad0c1d8a88 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:42.924063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 953/1890] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:42.925758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3c508-32dc-45a1-b5ec-581c2b977fce None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:42.926343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3c508-32dc-45a1-b5ec-581c2b977fce None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:42.926846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3c508-32dc-45a1-b5ec-581c2b977fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:42.964770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 938/1891] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:42 2022] POST /identity/v3/projects => generated 365 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:42.965504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-50a3c508-32dc-45a1-b5ec-581c2b977fce None None] MFA Rules not processed for user `e0f11f7caa424bc09460dee94ebba6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:42.966093 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:42.967150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-50a3c508-32dc-45a1-b5ec-581c2b977fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.055190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedae48-6c15-4bd3-b16b-a58834f9b6c1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.059210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 954/1892] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:43.060049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3c508-32dc-45a1-b5ec-581c2b977fce None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.074104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.074104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.074104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.074104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.074425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.085324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3c508-32dc-45a1-b5ec-581c2b977fce None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.085496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.090034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d9b6-a356-426f-af32-79a76e36cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.096098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 939/1893] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:43.099871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.105313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d9b6-a356-426f-af32-79a76e36cc1e admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.105607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d9b6-a356-426f-af32-79a76e36cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.106031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d9b6-a356-426f-af32-79a76e36cc1e admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.106752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d9b6-a356-426f-af32-79a76e36cc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.109132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d9b6-a356-426f-af32-79a76e36cc1e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.113449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c21e6-7f2f-48d4-b40d-43c94356a69d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.118713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.120145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.122184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.122658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] PATH_INFO: `/v3/projects/f616db9d61104e8b8719c1e2649032b6/users/835e4c30c6554a7ca98b66b141e217dc/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.124793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f616db9d61104e8b8719c1e2649032b6, user_id=835e4c30c6554a7ca98b66b141e217dc, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.128213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.142623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 940/1894] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:43 2022] PUT /identity/v3/projects/f616db9d61104e8b8719c1e2649032b6/users/835e4c30c6554a7ca98b66b141e217dc/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:43.143761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.145777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.198484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 955/1895] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:43 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:43.198484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ceb41-7102-4f6b-9640-34328dcbc25f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.198484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ceb41-7102-4f6b-9640-34328dcbc25f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.198484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ceb41-7102-4f6b-9640-34328dcbc25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.229937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-169ceb41-7102-4f6b-9640-34328dcbc25f None None] MFA Rules not processed for user `835e4c30c6554a7ca98b66b141e217dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:43.231521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-169ceb41-7102-4f6b-9640-34328dcbc25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.245915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bd52a-db87-41f3-aa92-c132a29e0c9c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.250221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.251581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.253767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.254059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.333697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 956/1896] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:43.333697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ceb41-7102-4f6b-9640-34328dcbc25f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.335974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.338938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.348597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 941/1897] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:43.364555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.373561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf8ac6-abd6-461a-8b3a-824931a60f9c service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.378407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.379066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.379346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.379618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.388762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.390227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.400845 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 942/1898] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:43.401762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.412509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ceb41-7102-4f6b-9640-34328dcbc25f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.417405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.418186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.418546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.418887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.419685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.421427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.441773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 957/1899] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:43.444610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.446492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.462802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4d7d-0acd-4041-8f9c-931888dd94b7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.471504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.471504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.471504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.471504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] PATH_INFO: `/v3/projects/758fa08d0973408d8d8c5ccbc8e02516` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.477003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758fa08d0973408d8d8c5ccbc8e02516)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.477003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.497844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae8e56-1ded-409a-87d9-3ef906c136ae service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.503003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.504027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.504409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.504754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] PATH_INFO: `/v3/users/e0f11f7caa424bc09460dee94ebba6d2` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.506066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f11f7caa424bc09460dee94ebba6d2)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.508027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.586411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758fa08d0973408d8d8c5ccbc8e02516', 'request_id': 'req-928605a2-44c5-43b5-9fd0-d2f1b687c264'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.659475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758fa08d0973408d8d8c5ccbc8e02516', 'request_id': 'req-928605a2-44c5-43b5-9fd0-d2f1b687c264'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.665396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758fa08d0973408d8d8c5ccbc8e02516', 'request_id': 'req-928605a2-44c5-43b5-9fd0-d2f1b687c264'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.678181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] The token cache is being invalidate because project 758fa08d0973408d8d8c5ccbc8e02516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:43.678584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.679234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.680889 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 958/1900] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:43 2022] DELETE /identity/v3/projects/758fa08d0973408d8d8c5ccbc8e02516 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:43.681683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.683205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.708814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f11f7caa424bc09460dee94ebba6d2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.709498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f11f7caa424bc09460dee94ebba6d2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.722147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f11f7caa424bc09460dee94ebba6d2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.722952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f11f7caa424bc09460dee94ebba6d2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.730214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f11f7caa424bc09460dee94ebba6d2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:43.752711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928605a2-44c5-43b5-9fd0-d2f1b687c264 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.757466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.758134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.758418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.758694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.759419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.761057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.771836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 959/1901] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:43.772639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.774297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.812750 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 943/1902] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:43 2022] DELETE /identity/v3/users/e0f11f7caa424bc09460dee94ebba6d2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:43.813839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.815213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.834984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0c792-9fe3-4a45-8466-33d00de69a75 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.880590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5764c21-af8a-4ae1-932c-f50c62744007 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:43.885239 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.886223 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.886512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.886780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] PATH_INFO: `/v3/users/89b0d75e332d4c28b429671772206ba7` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.888257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b0d75e332d4c28b429671772206ba7)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.890237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.895096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:43.895839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:43.896089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:43.896371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:43.898696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:43.968685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:43.970274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:43.983847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 960/1903] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:43.984748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:43.986673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:44.005025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aab81-99d4-473e-8751-1cdc136bbc55 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:44.012726 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf47a5-ec1d-4b4c-bdb8-de43a251afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:44.013757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf47a5-ec1d-4b4c-bdb8-de43a251afd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.014041 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf47a5-ec1d-4b4c-bdb8-de43a251afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.014308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf47a5-ec1d-4b4c-bdb8-de43a251afd3 admin admin] PATH_INFO: `/v3/projects/cb0a68df569a40d7a70e334c7c010259/users/5e124970bca54ce6875a30879dcc2086/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.036613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf47a5-ec1d-4b4c-bdb8-de43a251afd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0a68df569a40d7a70e334c7c010259, user_id=5e124970bca54ce6875a30879dcc2086, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:44.041611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf47a5-ec1d-4b4c-bdb8-de43a251afd3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:44.060387 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b0d75e332d4c28b429671772206ba7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:44.061272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b0d75e332d4c28b429671772206ba7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:44.077573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b0d75e332d4c28b429671772206ba7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:44.078691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b0d75e332d4c28b429671772206ba7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:44.086719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0692fd1e-0482-4714-8cf9-cb9c060769fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b0d75e332d4c28b429671772206ba7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:44.096413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 961/1904] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:43 2022] PUT /identity/v3/projects/cb0a68df569a40d7a70e334c7c010259/users/5e124970bca54ce6875a30879dcc2086/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:44.098351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.098622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.098901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.118212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:44.119787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:44.177411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 944/1905] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:43 2022] DELETE /identity/v3/users/89b0d75e332d4c28b429671772206ba7 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:44.180023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.180756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.181464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.193404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 962/1906] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:44.205419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:44.207216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:44.217399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] MFA Rules not processed for user `5e124970bca54ce6875a30879dcc2086`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:44.218921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:44.280497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6b1db-677f-48a9-ae58-2969a3bfc855 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:44.369342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 945/1907] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:44.370812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:44.372453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:44.393879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:44.396630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.396630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.396630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.468091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173420-9bef-49f1-b8a2-3d539d7f4e93 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:44.476638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:44.476834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:44.477694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.478082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.478193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:44.478538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.479506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:44.482314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:44.493917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 963/1908] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:44.588727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 946/1909] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:44 2022] POST /identity/v3/projects => generated 363 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:44.589991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:44.602440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ce5af-1eeb-4eb4-b3f8-e0b8395514bc service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:44.710610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:44.711291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.711583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.711853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.712661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:44.714629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:44.764007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:44.765748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:44.784649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7160a-ed8e-461b-8686-8732fafd9416 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:44.792838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:44.792838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.792838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.792838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] PATH_INFO: `/v3/projects/327084a367e147cd924bb03d6172e43a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.796839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327084a367e147cd924bb03d6172e43a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:44.799511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:44.825540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 964/1910] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:44 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:20:44.829275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:44.839447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94c39-8cb2-46ee-b300-8f379a51c1fd admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:44.846086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:44.846763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.847053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.847334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.848065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:44.849753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:44.862722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 965/1911] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:44.865346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:44.875381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b0bfc-7f21-42bc-8c94-134f6e056945 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:44.881481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:44.882448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:44.882765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:44.884769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] PATH_INFO: `/v3/projects/d057efcaf6b843ffa29eff83705750ab/users/9f039f7ec2394a0b97da4c9e9b1d27e9/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:44.899148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d057efcaf6b843ffa29eff83705750ab, user_id=9f039f7ec2394a0b97da4c9e9b1d27e9, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:44.902094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:44.974435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 966/1912] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:44 2022] PUT /identity/v3/projects/d057efcaf6b843ffa29eff83705750ab/users/9f039f7ec2394a0b97da4c9e9b1d27e9/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:44.978135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:44.982183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327084a367e147cd924bb03d6172e43a', 'request_id': 'req-3f742952-8061-483d-a739-8997b6fbb471'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.036152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327084a367e147cd924bb03d6172e43a', 'request_id': 'req-3f742952-8061-483d-a739-8997b6fbb471'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.042580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327084a367e147cd924bb03d6172e43a', 'request_id': 'req-3f742952-8061-483d-a739-8997b6fbb471'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.048365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938ef65-956f-47d2-a6d6-6934e5ff315b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.055484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] The token cache is being invalidate because project 327084a367e147cd924bb03d6172e43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:45.055775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.056468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.058178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 947/1913] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:44 2022] DELETE /identity/v3/projects/327084a367e147cd924bb03d6172e43a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:45.058957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.060216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.110988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e186a59-b244-4317-8efb-caf48a034ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.111669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186a59-b244-4317-8efb-caf48a034ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.111984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186a59-b244-4317-8efb-caf48a034ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.112268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186a59-b244-4317-8efb-caf48a034ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.113000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e186a59-b244-4317-8efb-caf48a034ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.114666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e186a59-b244-4317-8efb-caf48a034ed0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.129015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 967/1914] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:45.129015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.129015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.129015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.132244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742952-8061-483d-a739-8997b6fbb471 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.137398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.138273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.138610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.138888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] PATH_INFO: `/v3/projects/a734056d5c504d6ebe2800c66cf06cf7` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.140465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a734056d5c504d6ebe2800c66cf06cf7)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.143043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.148456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:45.149724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.162679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 968/1915] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:45.163650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.165017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.177654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a687-1d78-4b20-912c-dee75410fd91 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.183478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24460360-fd44-4d7a-8864-0173910f6eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.184385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460360-fd44-4d7a-8864-0173910f6eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.184671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460360-fd44-4d7a-8864-0173910f6eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.184947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24460360-fd44-4d7a-8864-0173910f6eb8 admin admin] PATH_INFO: `/v3/projects/d057efcaf6b843ffa29eff83705750ab/users/9f039f7ec2394a0b97da4c9e9b1d27e9/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.186997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24460360-fd44-4d7a-8864-0173910f6eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d057efcaf6b843ffa29eff83705750ab, user_id=9f039f7ec2394a0b97da4c9e9b1d27e9, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.190086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24460360-fd44-4d7a-8864-0173910f6eb8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.203083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 969/1916] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:45 2022] PUT /identity/v3/projects/d057efcaf6b843ffa29eff83705750ab/users/9f039f7ec2394a0b97da4c9e9b1d27e9/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:45.206497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75cacb-728a-4bd1-8d79-05a26cf68376 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.206497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75cacb-728a-4bd1-8d79-05a26cf68376 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.206497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75cacb-728a-4bd1-8d79-05a26cf68376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.227787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6f75cacb-728a-4bd1-8d79-05a26cf68376 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:45.228947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6f75cacb-728a-4bd1-8d79-05a26cf68376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.247814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a734056d5c504d6ebe2800c66cf06cf7', 'request_id': 'req-020bf884-65e1-433d-a3e3-a7b29014b8ec'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.300848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 970/1917] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:45.302226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e545-5ffa-4ca1-9e76-63860cd055d6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.302590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e545-5ffa-4ca1-9e76-63860cd055d6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.302793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e545-5ffa-4ca1-9e76-63860cd055d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.305019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a734056d5c504d6ebe2800c66cf06cf7', 'request_id': 'req-020bf884-65e1-433d-a3e3-a7b29014b8ec'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.316643 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a734056d5c504d6ebe2800c66cf06cf7', 'request_id': 'req-020bf884-65e1-433d-a3e3-a7b29014b8ec'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.329240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] The token cache is being invalidate because project a734056d5c504d6ebe2800c66cf06cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:45.329607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.330387 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:45.331980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 948/1918] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:45 2022] DELETE /identity/v3/projects/a734056d5c504d6ebe2800c66cf06cf7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:45.332759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.334110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.336946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8bc6e545-5ffa-4ca1-9e76-63860cd055d6 None None] MFA Rules not processed for user `9f039f7ec2394a0b97da4c9e9b1d27e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:45.338162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8bc6e545-5ffa-4ca1-9e76-63860cd055d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.347219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bf884-65e1-433d-a3e3-a7b29014b8ec admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.352171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2d34f-24ff-4da5-8b76-df55a0eacd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.352849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d34f-24ff-4da5-8b76-df55a0eacd22 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.353174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d34f-24ff-4da5-8b76-df55a0eacd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.353462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2d34f-24ff-4da5-8b76-df55a0eacd22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.354219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d34f-24ff-4da5-8b76-df55a0eacd22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:45.354532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d34f-24ff-4da5-8b76-df55a0eacd22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.356155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2d34f-24ff-4da5-8b76-df55a0eacd22 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.370449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 949/1919] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:45.372303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c136a4-c63f-4513-b045-51081623f42e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.372896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c136a4-c63f-4513-b045-51081623f42e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.373334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c136a4-c63f-4513-b045-51081623f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.402491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-84c136a4-c63f-4513-b045-51081623f42e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:45.404264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-84c136a4-c63f-4513-b045-51081623f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.418757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 950/1920] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:45.420283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c136a4-c63f-4513-b045-51081623f42e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.427786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 971/1921] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:45.429227 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b608a-95b8-48d5-8995-defccc564244 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.429519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b608a-95b8-48d5-8995-defccc564244 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.429796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b608a-95b8-48d5-8995-defccc564244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.445020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c136a4-c63f-4513-b045-51081623f42e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.451182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-769b608a-95b8-48d5-8995-defccc564244 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:45.452081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.452611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-769b608a-95b8-48d5-8995-defccc564244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.453483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.454211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.454859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.455984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.459706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.461833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 972/1922] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:45.463094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b608a-95b8-48d5-8995-defccc564244 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.465930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-769b608a-95b8-48d5-8995-defccc564244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:45.550831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b608a-95b8-48d5-8995-defccc564244 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.551933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 951/1923] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:45.557836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.621689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.622353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.622644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.623049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.633921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4e13a-a04e-48ff-b7f8-05c163094375 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.640966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.641698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.641991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.642617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.643960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:45.644267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.646306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.671926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 952/1924] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:45.671926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.686217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77da2e-c4eb-4f7d-a47a-d546f28c404e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.692201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.692969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.694116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.694614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.695311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.697351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.700521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.702046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.716915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 973/1925] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:45.717596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.730656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad3244-7122-45aa-8dd7-764f2cd12d02 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.736177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.736846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.737155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.737439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.738132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.740034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.819202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 953/1926] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:45.823245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.835827 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb52c43-9fcd-4b97-ab8e-e5867eb57a62 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.841228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.841913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.842195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.842474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.843264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.846254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.857586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 954/1927] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:45.862375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.871844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebf1e-6071-4fdc-a743-ffd98d866b7a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.876730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.877402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.877684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.877953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.878655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.880207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.889854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 955/1928] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:20:45.895120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.901555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 974/1929] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:45.905960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:45.907763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c784a-d70a-44f0-b131-4300428bca38 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.968254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211d110-1f2e-453d-921b-fc9472fca543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.969350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211d110-1f2e-453d-921b-fc9472fca543 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.970350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211d110-1f2e-453d-921b-fc9472fca543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.970635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211d110-1f2e-453d-921b-fc9472fca543 admin admin] PATH_INFO: `/v3/projects/478183a0670b439c990b51173762adcb/users/7aa6e8d68fd04c4eb40166d02335509d/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.975203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb97d4-36f5-40fe-bb7d-2623f7284e75 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:45.980262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:45.981060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:45.981330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:45.981610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:45.982309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.984438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:45.986316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211d110-1f2e-453d-921b-fc9472fca543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478183a0670b439c990b51173762adcb, user_id=7aa6e8d68fd04c4eb40166d02335509d, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:45.988929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211d110-1f2e-453d-921b-fc9472fca543 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:46.071590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 956/1930] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:45 2022] PUT /identity/v3/projects/478183a0670b439c990b51173762adcb/users/7aa6e8d68fd04c4eb40166d02335509d/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:46.083415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688daa5f-a573-4759-b1ac-af4d0779bedd None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.083734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688daa5f-a573-4759-b1ac-af4d0779bedd None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.084019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688daa5f-a573-4759-b1ac-af4d0779bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.111120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-688daa5f-a573-4759-b1ac-af4d0779bedd None None] MFA Rules not processed for user `7aa6e8d68fd04c4eb40166d02335509d`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:46.112555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-688daa5f-a573-4759-b1ac-af4d0779bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:46.137470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 975/1931] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:45 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:20:46.137470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:46.149869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40354c24-426d-4026-ba02-09a9e528f44e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:46.185282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 957/1932] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:46.186514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688daa5f-a573-4759-b1ac-af4d0779bedd None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:46.214170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:46.220948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.220948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.221293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.221981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:46.223654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:46.241447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 976/1933] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:46.241447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:46.252628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b225d-c8b6-4db8-9a18-0f05807869f0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:46.258649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:46.259319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.259604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.259977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.260906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:46.262562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:46.273629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 977/1934] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:46.274264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:46.276321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688daa5f-a573-4759-b1ac-af4d0779bedd None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:46.276462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:46.280539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c3d01-7d3c-487f-af83-1029c2b30c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:46.281276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c3d01-7d3c-487f-af83-1029c2b30c9c service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.281568 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c3d01-7d3c-487f-af83-1029c2b30c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.281849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c3d01-7d3c-487f-af83-1029c2b30c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.284364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-863c3d01-7d3c-487f-af83-1029c2b30c9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:46.289925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae9409-2ddb-46fd-a79b-49645129cba2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:46.293633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:46.294271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.294597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.294828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.304569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:46.306028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:46.315438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 978/1935] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:46.316246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:46.346077 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e4f66-5b98-4913-96ee-f9dbaa40ab1d service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:46.359532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:46.361675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.361675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.362083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] PATH_INFO: `/v3/projects/be8d9c0128bf4013a9039e41d2635204/users/71555227935f41e3818c6189eee30550/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.373517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c3d01-7d3c-487f-af83-1029c2b30c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:46.375266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c3d01-7d3c-487f-af83-1029c2b30c9c service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:46.399120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 958/1936] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:46.400504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8d9c0128bf4013a9039e41d2635204, user_id=71555227935f41e3818c6189eee30550, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:46.403816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:46.477977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 979/1937] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:46 2022] PUT /identity/v3/projects/be8d9c0128bf4013a9039e41d2635204/users/71555227935f41e3818c6189eee30550/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:46.489998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.491156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.492088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.528433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] MFA Rules not processed for user `71555227935f41e3818c6189eee30550`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:46.530125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:46.611425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 959/1938] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:46.838163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:46.898548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee60b12-f50a-45e7-b4ba-ae12a52b842e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:46.902248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6075105-e7be-428d-9683-4e501e1ca893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:46.902924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075105-e7be-428d-9683-4e501e1ca893 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:46.903217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075105-e7be-428d-9683-4e501e1ca893 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:46.903519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6075105-e7be-428d-9683-4e501e1ca893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:46.914312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6075105-e7be-428d-9683-4e501e1ca893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:46.915946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6075105-e7be-428d-9683-4e501e1ca893 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:46.926293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 980/1939] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:51.900630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:51.903926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:51.984277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba2690-eaf1-4b0a-a06a-6628dbf7fb30 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:51.990230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:51.991129 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:52.005468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:52.005468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] PATH_INFO: `/v3/users/bc86986053134a06a19320cc05df4037` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:52.006838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc86986053134a06a19320cc05df4037)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:52.009346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:52.229481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc86986053134a06a19320cc05df4037'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:52.230220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc86986053134a06a19320cc05df4037'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:52.243639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc86986053134a06a19320cc05df4037'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:52.244373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc86986053134a06a19320cc05df4037'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:52.256903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc86986053134a06a19320cc05df4037'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:52.345481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 960/1940] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:51 2022] DELETE /identity/v3/users/bc86986053134a06a19320cc05df4037 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:52.350056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:52.350564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:52.350564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:52.373330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:52.374543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:52.443400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 981/1941] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:20:52.460077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:52.461782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:52.529694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38028a82-b655-4c6c-88eb-7f3dae5b8573 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:52.533561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:52.534250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:52.534530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:52.534806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:52.544675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:52.546100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:52.556507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 961/1942] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:20:53.094883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:53.096340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:53.109682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beccd92-c820-4552-92f7-ff591d918cd5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:53.115771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:53.117818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:53.118105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:53.118383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] PATH_INFO: `/v3/projects/4ae14c10b27f4ac19b2ea58c553dc15c` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:53.120039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae14c10b27f4ac19b2ea58c553dc15c)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:53.122316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:53.239951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae14c10b27f4ac19b2ea58c553dc15c', 'request_id': 'req-2fd10338-6700-4974-b73a-799660ec208d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.316575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae14c10b27f4ac19b2ea58c553dc15c', 'request_id': 'req-2fd10338-6700-4974-b73a-799660ec208d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.323660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae14c10b27f4ac19b2ea58c553dc15c', 'request_id': 'req-2fd10338-6700-4974-b73a-799660ec208d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.336076 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] The token cache is being invalidate because project 4ae14c10b27f4ac19b2ea58c553dc15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:53.336362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.337024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.338588 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 982/1943] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:53 2022] DELETE /identity/v3/projects/4ae14c10b27f4ac19b2ea58c553dc15c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:53.342686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:53.352618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acce284-70c3-4277-9dfe-529dc5b111c2 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:53.414288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:53.415176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:53.415461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:53.415741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] PATH_INFO: `/v3/users/835e4c30c6554a7ca98b66b141e217dc` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:53.416932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] RBAC: Authorizing `identity:delete_user(user_id=835e4c30c6554a7ca98b66b141e217dc)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:53.418911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:53.616590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835e4c30c6554a7ca98b66b141e217dc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.617300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835e4c30c6554a7ca98b66b141e217dc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.630275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835e4c30c6554a7ca98b66b141e217dc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.631111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835e4c30c6554a7ca98b66b141e217dc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.638088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-237deec6-c858-4700-a12d-8c452dca996c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835e4c30c6554a7ca98b66b141e217dc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:53.727973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 962/1944] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:53 2022] DELETE /identity/v3/users/835e4c30c6554a7ca98b66b141e217dc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:54.181394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:54.182910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:54.198258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd10338-6700-4974-b73a-799660ec208d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:54.273661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:54.274491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:54.274783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:54.275063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] PATH_INFO: `/v3/projects/f616db9d61104e8b8719c1e2649032b6` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:54.276259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f616db9d61104e8b8719c1e2649032b6)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:54.278212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:54.408233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f616db9d61104e8b8719c1e2649032b6', 'request_id': 'req-fe083f8c-2ea4-43e9-b842-504e4cdbab53'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:54.492970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f616db9d61104e8b8719c1e2649032b6', 'request_id': 'req-fe083f8c-2ea4-43e9-b842-504e4cdbab53'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:54.501967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f616db9d61104e8b8719c1e2649032b6', 'request_id': 'req-fe083f8c-2ea4-43e9-b842-504e4cdbab53'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:54.513781 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] The token cache is being invalidate because project f616db9d61104e8b8719c1e2649032b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:54.514075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:54.514944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe083f8c-2ea4-43e9-b842-504e4cdbab53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:54.517161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 983/1945] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:54 2022] DELETE /identity/v3/projects/f616db9d61104e8b8719c1e2649032b6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:54.526439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf0c1-9906-4f7d-a771-6576a7f76124 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:54.526439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf0c1-9906-4f7d-a771-6576a7f76124 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:54.526439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cf0c1-9906-4f7d-a771-6576a7f76124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:54.543008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b24cf0c1-9906-4f7d-a771-6576a7f76124 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:54.544354 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b24cf0c1-9906-4f7d-a771-6576a7f76124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:54.606850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 963/1946] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:54.615448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a915-68dd-421a-b12d-d7e85f0e6452 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:54.615739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a915-68dd-421a-b12d-d7e85f0e6452 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:54.616022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a915-68dd-421a-b12d-d7e85f0e6452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:54.637033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-fed7a915-68dd-421a-b12d-d7e85f0e6452 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:54.638347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fed7a915-68dd-421a-b12d-d7e85f0e6452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:54.650984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 984/1947] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:54.655417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cf0c1-9906-4f7d-a771-6576a7f76124 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:54.666033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cf0c1-9906-4f7d-a771-6576a7f76124 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:54.671102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:54.671787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:54.672077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:54.672360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:54.673177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:54.673490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:54.675143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:54.687794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 964/1948] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:20:54.692903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a915-68dd-421a-b12d-d7e85f0e6452 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:54.702734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a915-68dd-421a-b12d-d7e85f0e6452 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:54.708178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:54.708879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:54.709244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:54.709517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:54.710255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:54.712157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:54.780582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 985/1949] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:54 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:54.784761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:54.794744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc243-7de1-4f91-a3ee-e8943e92fc4f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:54.853563 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:54.854247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:54.854597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:54.854883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:54.855676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:54.857626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:54.963109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 965/1950] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:54 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:54.968181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:54.979496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e88bc-ee76-44fb-8650-b771bcf9109c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:54.984869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:54.986777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:54.987047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:54.987331 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:54.988078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:54.989773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.008379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 986/1951] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:55.012083 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.021915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf067f-0f21-4fb4-9fc9-619fb556bc63 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.030155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f6057-d2a0-415a-9b7c-e03c74e01d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.030917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f6057-d2a0-415a-9b7c-e03c74e01d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.031170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f6057-d2a0-415a-9b7c-e03c74e01d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.031454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f6057-d2a0-415a-9b7c-e03c74e01d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.033307 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f6057-d2a0-415a-9b7c-e03c74e01d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.035064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f6057-d2a0-415a-9b7c-e03c74e01d6c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.052394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 966/1952] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:55.052591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.060602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb47d4-962a-4daf-84a6-f1ee5447df98 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.066992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.068254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.068254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.068562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] PATH_INFO: `/v3/projects/475ff80ad7d94793b52e8cc94b849cd4/users/00a1341abcdc43b9818446766856134c/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.094128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475ff80ad7d94793b52e8cc94b849cd4, user_id=00a1341abcdc43b9818446766856134c, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.098259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.159983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 987/1953] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:55 2022] PUT /identity/v3/projects/475ff80ad7d94793b52e8cc94b849cd4/users/00a1341abcdc43b9818446766856134c/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:55.170911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a828e8-8462-49fb-977a-65eddfc38a52 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.171211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a828e8-8462-49fb-977a-65eddfc38a52 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.171501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a828e8-8462-49fb-977a-65eddfc38a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.203328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-56a828e8-8462-49fb-977a-65eddfc38a52 None None] MFA Rules not processed for user `00a1341abcdc43b9818446766856134c`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:55.204647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-56a828e8-8462-49fb-977a-65eddfc38a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:55.286912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 967/1954] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:55.288452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.356523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30218-14af-4859-b59b-157b87687137 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.362753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.363622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.363721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.363979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.364952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.367041 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.472746 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 988/1955] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:55 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:55.477394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a828e8-8462-49fb-977a-65eddfc38a52 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.488931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a828e8-8462-49fb-977a-65eddfc38a52 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.559237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.559237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.559237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.559237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.560027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.561436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.648266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 968/1956] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:20:55 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:20:55.652412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.663676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e4f03-2fe7-474c-98e5-cd5c7a3b5e61 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.670319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.670319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.670319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.670319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.670616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.671887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.683438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 989/1957] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:55.687897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.698979 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4eac5-6b88-4269-9988-08fa8ca5456c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.704212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.705218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.705506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.705782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] PATH_INFO: `/v3/projects/100ec9da4cf648978a16504b45c2ed1e/users/c324790b7fb94e448843ace74f3264f6/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.720724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ec9da4cf648978a16504b45c2ed1e, user_id=c324790b7fb94e448843ace74f3264f6, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.723399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.825217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 969/1958] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:55 2022] PUT /identity/v3/projects/100ec9da4cf648978a16504b45c2ed1e/users/c324790b7fb94e448843ace74f3264f6/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:55.829605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.839806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103da71-8dd1-482f-bd53-5e804713db5a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.895058 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418146af-909b-4c02-9533-de4b61a31618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.895732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418146af-909b-4c02-9533-de4b61a31618 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.896022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418146af-909b-4c02-9533-de4b61a31618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.896297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418146af-909b-4c02-9533-de4b61a31618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.897025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418146af-909b-4c02-9533-de4b61a31618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.898771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418146af-909b-4c02-9533-de4b61a31618 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.914648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 990/1959] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:20:55.916216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:55.928857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94cd6b-dde8-4853-ae09-cd4c9a9dac9f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:55.933835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:55.934748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.935038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.935353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] PATH_INFO: `/v3/projects/100ec9da4cf648978a16504b45c2ed1e/users/c324790b7fb94e448843ace74f3264f6/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.937556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100ec9da4cf648978a16504b45c2ed1e, user_id=c324790b7fb94e448843ace74f3264f6, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:55.941170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:55.952198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 970/1960] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:20:55 2022] PUT /identity/v3/projects/100ec9da4cf648978a16504b45c2ed1e/users/c324790b7fb94e448843ace74f3264f6/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:55.963855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976504-1445-4a87-bb65-3fed8690b25a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:55.964152 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976504-1445-4a87-bb65-3fed8690b25a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:55.964436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976504-1445-4a87-bb65-3fed8690b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:55.993121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e0976504-1445-4a87-bb65-3fed8690b25a None None] MFA Rules not processed for user `c324790b7fb94e448843ace74f3264f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:55.994333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e0976504-1445-4a87-bb65-3fed8690b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:56.067723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 991/1961] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:56.073855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:56.076049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:56.133932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c593aeb-640a-4896-ab57-79c9f6c34596 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:56.137884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faba558-2908-4974-aabc-ed1bcb83dc4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:56.138534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faba558-2908-4974-aabc-ed1bcb83dc4b service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:56.138818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faba558-2908-4974-aabc-ed1bcb83dc4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:56.139095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faba558-2908-4974-aabc-ed1bcb83dc4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:56.149666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faba558-2908-4974-aabc-ed1bcb83dc4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:56.151381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faba558-2908-4974-aabc-ed1bcb83dc4b service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:56.164162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 971/1962] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:57.370160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0976504-1445-4a87-bb65-3fed8690b25a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:57.443111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0976504-1445-4a87-bb65-3fed8690b25a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:57.450818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:57.452396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:57.452910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:57.453509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] PATH_INFO: `/v3/users/00a1341abcdc43b9818446766856134c` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:57.458534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a1341abcdc43b9818446766856134c)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:57.459852 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:57.599757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a1341abcdc43b9818446766856134c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:57.600711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a1341abcdc43b9818446766856134c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:57.607605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a1341abcdc43b9818446766856134c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:57.620444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a1341abcdc43b9818446766856134c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:57.621199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a1341abcdc43b9818446766856134c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:57.682051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 992/1963] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:57 2022] DELETE /identity/v3/users/00a1341abcdc43b9818446766856134c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:57.686696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:57.687180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:57.689474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:57.708608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:57.709873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:57.775136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 972/1964] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:57.785285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:57.786702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:57.854726 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76192c09-c87e-46c9-95df-aac11e97d242 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:57.858606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:57.863319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:57.863319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:57.863319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:57.870591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:57.872051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:57.883073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 993/1965] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:58.170233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:58.171692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:58.185475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d259-831e-48e5-9ab0-73fbf485bc8d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:58.192847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:58.196055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:58.196055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:58.196055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] PATH_INFO: `/v3/users/71555227935f41e3818c6189eee30550` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:58.196650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71555227935f41e3818c6189eee30550)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:58.198762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:58.373925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:58.375381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:58.393595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360b45-2849-4431-83ba-3dc897309d33 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:58.403501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:58.405825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:58.405825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:58.405825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] PATH_INFO: `/v3/projects/475ff80ad7d94793b52e8cc94b849cd4` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:58.408072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475ff80ad7d94793b52e8cc94b849cd4)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:58.414404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:58.415889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71555227935f41e3818c6189eee30550'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.416600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71555227935f41e3818c6189eee30550'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.434193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71555227935f41e3818c6189eee30550'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.435041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71555227935f41e3818c6189eee30550'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.442494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-81f737c7-7a38-440a-b1f7-ff34f1dc6d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71555227935f41e3818c6189eee30550'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.535936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 973/1966] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:58 2022] DELETE /identity/v3/users/71555227935f41e3818c6189eee30550 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:58.540639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:58.541012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:58.541443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:58.554576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475ff80ad7d94793b52e8cc94b849cd4', 'request_id': 'req-10108f25-7155-4b66-a203-f541da379e09'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.560098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:58.561345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:58.622042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 974/1967] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:58.633109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:58.634621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:58.635962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475ff80ad7d94793b52e8cc94b849cd4', 'request_id': 'req-10108f25-7155-4b66-a203-f541da379e09'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.644621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475ff80ad7d94793b52e8cc94b849cd4', 'request_id': 'req-10108f25-7155-4b66-a203-f541da379e09'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.659172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] The token cache is being invalidate because project 475ff80ad7d94793b52e8cc94b849cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:58.659947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.661208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.663853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 994/1968] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:58 2022] DELETE /identity/v3/projects/475ff80ad7d94793b52e8cc94b849cd4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:58.670701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:58.673452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:58.706281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a17d-752b-4cd1-a695-4d8a8022aac2 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:58.710176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:58.710988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:58.711273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:58.711550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:58.713570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:58.727048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:58.728895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:58.743331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 975/1969] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:20:58.763132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10108f25-7155-4b66-a203-f541da379e09 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:58.768716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:58.769589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:58.769872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:58.770207 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] PATH_INFO: `/v3/users/c324790b7fb94e448843ace74f3264f6` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:58.771591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c324790b7fb94e448843ace74f3264f6)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:58.773691 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:58.917464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c324790b7fb94e448843ace74f3264f6'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.918174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c324790b7fb94e448843ace74f3264f6'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.930521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c324790b7fb94e448843ace74f3264f6'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.962071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c324790b7fb94e448843ace74f3264f6'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:58.963171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c324790b7fb94e448843ace74f3264f6'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.039911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 995/1970] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:58 2022] DELETE /identity/v3/users/c324790b7fb94e448843ace74f3264f6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:59.152542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:59.154278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:59.189622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b60346-6c08-4a9d-be5c-bd4f0ed2ebe6 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:59.242881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:59.243741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.244022 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.244294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] PATH_INFO: `/v3/projects/be8d9c0128bf4013a9039e41d2635204` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.245509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8d9c0128bf4013a9039e41d2635204)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:59.247386 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:59.283789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:59.285289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:59.299065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048773b6-5a87-45b5-97c4-63fdfd17346c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:59.303723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:59.304582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.304866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.305169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] PATH_INFO: `/v3/users/7aa6e8d68fd04c4eb40166d02335509d` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.306341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa6e8d68fd04c4eb40166d02335509d)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:59.308258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:59.393645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8d9c0128bf4013a9039e41d2635204', 'request_id': 'req-d0b0ccd3-3223-47a7-b418-d974565cc9b3'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.498837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8d9c0128bf4013a9039e41d2635204', 'request_id': 'req-d0b0ccd3-3223-47a7-b418-d974565cc9b3'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.505660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8d9c0128bf4013a9039e41d2635204', 'request_id': 'req-d0b0ccd3-3223-47a7-b418-d974565cc9b3'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.523255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] The token cache is being invalidate because project be8d9c0128bf4013a9039e41d2635204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:59.523540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.524178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0b0ccd3-3223-47a7-b418-d974565cc9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.526064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 976/1971] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:59 2022] DELETE /identity/v3/projects/be8d9c0128bf4013a9039e41d2635204 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:59.530941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326026-4f70-4c48-b546-5886f9643b29 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.532634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326026-4f70-4c48-b546-5886f9643b29 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.532634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4326026-4f70-4c48-b546-5886f9643b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.540804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa6e8d68fd04c4eb40166d02335509d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.540804 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa6e8d68fd04c4eb40166d02335509d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.543700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa6e8d68fd04c4eb40166d02335509d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.553889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d4326026-4f70-4c48-b546-5886f9643b29 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:59.555103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d4326026-4f70-4c48-b546-5886f9643b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:59.556950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa6e8d68fd04c4eb40166d02335509d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.557812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa6e8d68fd04c4eb40166d02335509d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.621574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 996/1972] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:20:59 2022] DELETE /identity/v3/users/7aa6e8d68fd04c4eb40166d02335509d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:20:59.622550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:59.624106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:59.632707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 977/1973] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:59.634150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0dcc3-cefb-4460-8772-1651a98c096a None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.634385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0dcc3-cefb-4460-8772-1651a98c096a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.634664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0dcc3-cefb-4460-8772-1651a98c096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.655996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0bf0dcc3-cefb-4460-8772-1651a98c096a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:59.658156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0bf0dcc3-cefb-4460-8772-1651a98c096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:59.704862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5339a-d687-406c-a954-e68c48f39546 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:59.709757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:59.710630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.710913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.711180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] PATH_INFO: `/v3/projects/100ec9da4cf648978a16504b45c2ed1e` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.712370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100ec9da4cf648978a16504b45c2ed1e)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:59.715176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:59.719858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 978/1974] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:59.725813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.726274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.726825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.748441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:20:59.748441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:59.757713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 979/1975] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:20:59.759426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:59.760942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:20:59.823648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e0fce-ef15-4cd8-9875-affea6b54213 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:59.828713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:59.829940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.830353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.830639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.841222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:59.842720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:59.857409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 980/1976] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:20:59.859364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100ec9da4cf648978a16504b45c2ed1e', 'request_id': 'req-d8f3a430-63ee-4062-8455-2eec5d15ea05'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.866262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:59.878539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6fabb-d576-45cc-aff8-82c2de1a9ca1 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:20:59.944797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100ec9da4cf648978a16504b45c2ed1e', 'request_id': 'req-d8f3a430-63ee-4062-8455-2eec5d15ea05'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.956028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100ec9da4cf648978a16504b45c2ed1e', 'request_id': 'req-d8f3a430-63ee-4062-8455-2eec5d15ea05'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.972249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:20:59.972940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.973257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.973539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.974286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:20:59.974588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:20:59.976206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:20:59.979055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] The token cache is being invalidate because project 100ec9da4cf648978a16504b45c2ed1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:20:59.979786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.981512 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d8f3a430-63ee-4062-8455-2eec5d15ea05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:20:59.990118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 997/1977] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:20:59 2022] DELETE /identity/v3/projects/100ec9da4cf648978a16504b45c2ed1e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:20:59.991963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d4e49-1c9d-447e-a56d-1a400a02bc92 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:20:59.992199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 981/1978] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:20:59.992717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d4e49-1c9d-447e-a56d-1a400a02bc92 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:20:59.993055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d4e49-1c9d-447e-a56d-1a400a02bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:20:59.996804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:20:59.998448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:00.012153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475a4bc-37a2-493f-81d1-ed783fab0015 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.019166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-607d4e49-1c9d-447e-a56d-1a400a02bc92 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:00.021029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-607d4e49-1c9d-447e-a56d-1a400a02bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:00.025921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.026608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.026893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.027172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.028332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.029873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 998/1979] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:00.033925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.039132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5eabb-91ed-4856-8b40-cfc010676ab8 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.039615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5eabb-91ed-4856-8b40-cfc010676ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.040109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5eabb-91ed-4856-8b40-cfc010676ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.074068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f6a5eabb-91ed-4856-8b40-cfc010676ab8 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:00.076253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f6a5eabb-91ed-4856-8b40-cfc010676ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:00.088964 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 999/1980] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:00.101528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5eabb-91ed-4856-8b40-cfc010676ab8 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.115407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5eabb-91ed-4856-8b40-cfc010676ab8 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.120747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.121150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.121419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.121740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.122472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:00.122783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.126383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.135675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 982/1981] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:20:59 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:00.139920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.144599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1000/1982] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:00.149363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.160519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48be47-f5dd-4d0c-b5b0-8bd2bc795c96 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.233009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ca011-9cf8-4eb8-8839-5307f5f99060 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.238799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.239608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.240099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.241030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.241763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.243703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.254983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.255648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.255931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.256205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.257002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.258921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.323424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 983/1983] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:00 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:00.328541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.342076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec2541-1ef1-4f23-9ab4-b9e3a5b0e62c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.348553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.349626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.350058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.350415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.351284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.353327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.364348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1001/1984] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:00 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:00.365011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.367555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:00.373383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 984/1985] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:00.373383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.382861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21125b9-715a-47bb-8ad1-58f8da9d6b39 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.450874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4098d80-0bda-4b28-8e40-d4f4dafe090f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.456964 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.457958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.458248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.458784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] PATH_INFO: `/v3/projects/478183a0670b439c990b51173762adcb` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.461245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=478183a0670b439c990b51173762adcb)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.463191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.463782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.464565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.466912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.466912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.466912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.468547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.562310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 985/1986] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:00 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:00.563752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.573676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06761bf-e065-4876-9dd9-c47d9cfd7961 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.579971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.580496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.580866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.581560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.581942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.583694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.594284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 986/1987] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:00.595287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.603922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478183a0670b439c990b51173762adcb', 'request_id': 'req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:00.606570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcdb11-f9db-43b9-b644-df636a23964b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.665893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.666638 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.666931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.667210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.668040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.669879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.678647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478183a0670b439c990b51173762adcb', 'request_id': 'req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:00.685833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478183a0670b439c990b51173762adcb', 'request_id': 'req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:00.686019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 987/1988] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:00.687228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.701056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] The token cache is being invalidate because project 478183a0670b439c990b51173762adcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:00.701533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:00.704870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:00.705224 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1002/1989] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:00 2022] DELETE /identity/v3/projects/478183a0670b439c990b51173762adcb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:00.710226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771936a7-2bdd-43ec-a62f-fa2091a80e39 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.710777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.713228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:00.724276 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b24f3f-9e8e-4cd7-b474-b55ebc90aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.725638 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b24f3f-9e8e-4cd7-b474-b55ebc90aed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.728501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b24f3f-9e8e-4cd7-b474-b55ebc90aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.737791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29d0c0-c4e9-46ab-b6bb-5658710b9010 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.738329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b24f3f-9e8e-4cd7-b474-b55ebc90aed2 admin admin] PATH_INFO: `/v3/projects/e5bdf677626648cd9862d28a600abc09/users/4a9ae0ee1ff94e9dba619ccb8224d627/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.747037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c5a45-44c6-49ff-95c6-25788783e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.749896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5a45-44c6-49ff-95c6-25788783e287 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.749896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5a45-44c6-49ff-95c6-25788783e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.749896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5a45-44c6-49ff-95c6-25788783e287 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.749896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c5a45-44c6-49ff-95c6-25788783e287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.751866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c5a45-44c6-49ff-95c6-25788783e287 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.755965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b24f3f-9e8e-4cd7-b474-b55ebc90aed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bdf677626648cd9862d28a600abc09, user_id=4a9ae0ee1ff94e9dba619ccb8224d627, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.759131 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b24f3f-9e8e-4cd7-b474-b55ebc90aed2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.768922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1003/1990] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:00.770391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704937e3-39bf-4043-88b0-75975cdc27f6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.770839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704937e3-39bf-4043-88b0-75975cdc27f6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.772828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704937e3-39bf-4043-88b0-75975cdc27f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.794870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-704937e3-39bf-4043-88b0-75975cdc27f6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:00.796091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-704937e3-39bf-4043-88b0-75975cdc27f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:00.805859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1004/1991] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:00.806829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704937e3-39bf-4043-88b0-75975cdc27f6 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:00.819543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704937e3-39bf-4043-88b0-75975cdc27f6 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:00.820107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 988/1992] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:00 2022] PUT /identity/v3/projects/e5bdf677626648cd9862d28a600abc09/users/4a9ae0ee1ff94e9dba619ccb8224d627/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:00.821626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26a163-a3c3-42b9-b612-e4355139d3c3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.821918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26a163-a3c3-42b9-b612-e4355139d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.822199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26a163-a3c3-42b9-b612-e4355139d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.842026 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-cb26a163-a3c3-42b9-b612-e4355139d3c3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:00.843150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cb26a163-a3c3-42b9-b612-e4355139d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:00.904275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:00.904275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.904275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.904275 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] PATH_INFO: `/v3/projects/c651141316c94c24802266a0752ad29d/users/8ce8ac95051f42c1bccc3061e145f093/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.909363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 989/1993] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:00.911054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086e8a-33c4-4ffd-8429-1dbada8b2ab2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:00.911682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086e8a-33c4-4ffd-8429-1dbada8b2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:00.912274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086e8a-33c4-4ffd-8429-1dbada8b2ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:00.916212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c651141316c94c24802266a0752ad29d, user_id=8ce8ac95051f42c1bccc3061e145f093, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:00.918922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:00.939804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2b086e8a-33c4-4ffd-8429-1dbada8b2ab2 None None] MFA Rules not processed for user `4a9ae0ee1ff94e9dba619ccb8224d627`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:00.941183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2b086e8a-33c4-4ffd-8429-1dbada8b2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.010596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 990/1994] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:01.011490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086e8a-33c4-4ffd-8429-1dbada8b2ab2 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.020259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1005/1995] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:00 2022] PUT /identity/v3/projects/c651141316c94c24802266a0752ad29d/users/8ce8ac95051f42c1bccc3061e145f093/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:01.024049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.024874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.038419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086e8a-33c4-4ffd-8429-1dbada8b2ab2 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.086715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be043ea-99aa-4b70-bd65-1d77f11bf44e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.090620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.091271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.091557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.091835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.105809 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a61fa-f05d-43e9-9c64-db151817581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.106406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a61fa-f05d-43e9-9c64-db151817581f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.106694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a61fa-f05d-43e9-9c64-db151817581f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.106980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a61fa-f05d-43e9-9c64-db151817581f admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.107702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a61fa-f05d-43e9-9c64-db151817581f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:01.108008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a61fa-f05d-43e9-9c64-db151817581f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.109684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a61fa-f05d-43e9-9c64-db151817581f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.127900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 991/1996] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:01.138051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.138051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.138051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.151877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.153356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.163183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] MFA Rules not processed for user `8ce8ac95051f42c1bccc3061e145f093`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:01.167686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1006/1997] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:01.167686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.167859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.175477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24a218-5903-40c6-ab90-c946665f3d31 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.180539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.181418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.181703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.181982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.182669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.188887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.244225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 992/1998] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:01.245140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.246469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.262415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af19d02-9ad1-4863-b805-d70961d90ff4 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.267342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.268238 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.268519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.268798 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] PATH_INFO: `/v3/users/4a9ae0ee1ff94e9dba619ccb8224d627` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.270128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9ae0ee1ff94e9dba619ccb8224d627)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.272054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.386847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1007/1999] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:01 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:01.390427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.457285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e6011-2503-4f64-b298-a2d51d821a02 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.462020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.462674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.463001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.463294 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.463986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.466054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.541891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9ae0ee1ff94e9dba619ccb8224d627'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:01.542552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9ae0ee1ff94e9dba619ccb8224d627'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:01.554934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9ae0ee1ff94e9dba619ccb8224d627'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:01.555576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9ae0ee1ff94e9dba619ccb8224d627'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:01.562705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9ae0ee1ff94e9dba619ccb8224d627'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:01.566222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1008/2000] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:01 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:01.566222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.566222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.627685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19471dd9-76fa-4b0f-b243-f61a2b2f09de admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.632637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e52f01-b5d0-4c82-9580-01ac69af22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.633345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52f01-b5d0-4c82-9580-01ac69af22fa admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.633635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52f01-b5d0-4c82-9580-01ac69af22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.633912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52f01-b5d0-4c82-9580-01ac69af22fa admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.634651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e52f01-b5d0-4c82-9580-01ac69af22fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.636571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e52f01-b5d0-4c82-9580-01ac69af22fa admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.648991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 993/2001] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:01 2022] DELETE /identity/v3/users/4a9ae0ee1ff94e9dba619ccb8224d627 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:01.650140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.651345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.715817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0c68f-6dbd-4082-998a-ccd374cfe695 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.721106 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.721790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.722077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.722354 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.723056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.724943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.748342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1009/2002] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:01 2022] POST /identity/v3/users => generated 284 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:01.749837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd68b-4fe2-4553-88b1-608eddf29c12 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.750137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd68b-4fe2-4553-88b1-608eddf29c12 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.750422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccd68b-4fe2-4553-88b1-608eddf29c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.772490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2bccd68b-4fe2-4553-88b1-608eddf29c12 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:01.773855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2bccd68b-4fe2-4553-88b1-608eddf29c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.795268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1010/2003] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:01.795268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd68b-4fe2-4553-88b1-608eddf29c12 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.800423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccd68b-4fe2-4553-88b1-608eddf29c12 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.805734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.808201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.808201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.808201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.808201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.809517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.821035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1011/2004] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:01.821035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.824175 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:01.857341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 994/2005] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:01 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:01.857341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.871640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834ade8-c69f-48c4-9c46-2bc98b155fee admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.881888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.882584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.882869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.883224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.883875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.885528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.901193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 995/2006] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:01.901475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.904895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e930f3-30c1-408c-8051-3628ce871583 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.910463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.911470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.912180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.912180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.916272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2046dc1-8ac7-4039-8c65-55486fe0cd48 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.929358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.929358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.929577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.929577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.929577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.937732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.939846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1012/2007] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:01.940653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.945378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.947162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.964481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6aee0-39ba-4f40-b7ba-b9dcfabaae2a service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:01.967937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 996/2008] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:01.972389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:01.972495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c98fa-2e40-4116-859f-fceb9667d032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:01.973374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c98fa-2e40-4116-859f-fceb9667d032 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:01.973665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c98fa-2e40-4116-859f-fceb9667d032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:01.974085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c98fa-2e40-4116-859f-fceb9667d032 admin admin] PATH_INFO: `/v3/projects/d9135afa48734c6a93dba0254e734a7d/users/fd3e45d80255452cb9c10e6c971c878e/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:01.994985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c98fa-2e40-4116-859f-fceb9667d032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9135afa48734c6a93dba0254e734a7d, user_id=fd3e45d80255452cb9c10e6c971c878e, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:01.998943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c98fa-2e40-4116-859f-fceb9667d032 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:01.999835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86b76b-ab4d-4d59-9f90-1486b64f2bed admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:02.013319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:02.014363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.014749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.015322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] PATH_INFO: `/v3/projects/6ea4f0ce84b14d37b8f6d994ce08909b/users/3556b50eba2f4d53824022166ed2a95b/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.041998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea4f0ce84b14d37b8f6d994ce08909b, user_id=3556b50eba2f4d53824022166ed2a95b, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:02.045782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:02.091631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1013/2009] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:01 2022] PUT /identity/v3/projects/d9135afa48734c6a93dba0254e734a7d/users/fd3e45d80255452cb9c10e6c971c878e/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:02.114733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4d6c-8c80-4a56-ab65-d8c3b35dc621 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.117404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4d6c-8c80-4a56-ab65-d8c3b35dc621 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.117740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d4d6c-8c80-4a56-ab65-d8c3b35dc621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.147478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 997/2010] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:01 2022] PUT /identity/v3/projects/6ea4f0ce84b14d37b8f6d994ce08909b/users/3556b50eba2f4d53824022166ed2a95b/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:02.148447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:02.164354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c91d4d6c-8c80-4a56-ab65-d8c3b35dc621 None None] MFA Rules not processed for user `fd3e45d80255452cb9c10e6c971c878e`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:02.165796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c91d4d6c-8c80-4a56-ab65-d8c3b35dc621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.275704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60165f88-e836-4819-a7d8-9028ba2de140 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:02.280888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:02.281610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.282000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.282277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.283030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:02.285068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:02.295594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1014/2011] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:02.296254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 998/2012] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:02.304131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4d6c-8c80-4a56-ab65-d8c3b35dc621 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:02.310623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:02.315004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.326891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d4d6c-8c80-4a56-ab65-d8c3b35dc621 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:02.334053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:02.335762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.336786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.337731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] PATH_INFO: `/v3/projects/6ea4f0ce84b14d37b8f6d994ce08909b/users/3556b50eba2f4d53824022166ed2a95b/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.340509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea4f0ce84b14d37b8f6d994ce08909b, user_id=3556b50eba2f4d53824022166ed2a95b, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:02.343564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:02.359744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1015/2013] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:02 2022] PUT /identity/v3/projects/6ea4f0ce84b14d37b8f6d994ce08909b/users/3556b50eba2f4d53824022166ed2a95b/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:02.369759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:02.369759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.391270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c358dc-0844-453f-9185-647240061f4a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:02.441869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf2af-9cbd-47f4-9938-d38d25066bd1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:02.447778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:02.448668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.448951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.449260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] PATH_INFO: `/v3/users/5e124970bca54ce6875a30879dcc2086` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.450493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e124970bca54ce6875a30879dcc2086)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:02.452686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:02.455856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c46d00-6b00-4e33-9f78-454634cdb33c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:02.456511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46d00-6b00-4e33-9f78-454634cdb33c service glance] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.456936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46d00-6b00-4e33-9f78-454634cdb33c service glance] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.457373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46d00-6b00-4e33-9f78-454634cdb33c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.525391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c46d00-6b00-4e33-9f78-454634cdb33c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:02.526919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c46d00-6b00-4e33-9f78-454634cdb33c service glance] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:02.538201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 999/2014] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:02.539573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.539864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.540139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.571166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] MFA Rules not processed for user `3556b50eba2f4d53824022166ed2a95b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:02.572392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.613176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e124970bca54ce6875a30879dcc2086'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.614274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e124970bca54ce6875a30879dcc2086'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.627226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e124970bca54ce6875a30879dcc2086'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.643518 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e124970bca54ce6875a30879dcc2086'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.645997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e124970bca54ce6875a30879dcc2086'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.679155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1000/2015] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:02.680549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:02.686680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.706191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723e8bd-e6de-4196-8691-c4051206c9f0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:02.717180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:02.718149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.718435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.718710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] PATH_INFO: `/v3/projects/e5bdf677626648cd9862d28a600abc09` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.720528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bdf677626648cd9862d28a600abc09)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:02.722495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:02.734690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1016/2016] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:02 2022] DELETE /identity/v3/users/5e124970bca54ce6875a30879dcc2086 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:02.734690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:02.736642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.803989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f2d87-18af-4592-94d6-599fc742d81a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:02.803989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b001d-75a8-4463-be37-3b83c721e4a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:02.803989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b001d-75a8-4463-be37-3b83c721e4a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.803989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b001d-75a8-4463-be37-3b83c721e4a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.804415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b001d-75a8-4463-be37-3b83c721e4a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.806353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-537b001d-75a8-4463-be37-3b83c721e4a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.867094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bdf677626648cd9862d28a600abc09', 'request_id': 'req-d7b697f1-dc61-478f-8032-78a197d71439'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.870269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b001d-75a8-4463-be37-3b83c721e4a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:02.871723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b001d-75a8-4463-be37-3b83c721e4a4 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:02.881179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1017/2017] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:02.882471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.882815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.883093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:02.902310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:02.903825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:02.945533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bdf677626648cd9862d28a600abc09', 'request_id': 'req-d7b697f1-dc61-478f-8032-78a197d71439'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.954858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bdf677626648cd9862d28a600abc09', 'request_id': 'req-d7b697f1-dc61-478f-8032-78a197d71439'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.974341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] The token cache is being invalidate because project e5bdf677626648cd9862d28a600abc09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:02.974729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.975289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d7b697f1-dc61-478f-8032-78a197d71439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:02.977110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1001/2018] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:02 2022] DELETE /identity/v3/projects/e5bdf677626648cd9862d28a600abc09 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:02.977241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1018/2019] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:02.982176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e7ba-f62a-4ea1-95a1-15a0e20b9adc None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:02.982525 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e7ba-f62a-4ea1-95a1-15a0e20b9adc None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:02.982981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e7ba-f62a-4ea1-95a1-15a0e20b9adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.005721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.007879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:03.020200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-9ba7e7ba-f62a-4ea1-95a1-15a0e20b9adc None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:03.021852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9ba7e7ba-f62a-4ea1-95a1-15a0e20b9adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:03.035488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1002/2020] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:03.046872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ba4d5-abf5-4c54-b69a-b8d147590701 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.047250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ba4d5-abf5-4c54-b69a-b8d147590701 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.048329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ba4d5-abf5-4c54-b69a-b8d147590701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.069139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-806ba4d5-abf5-4c54-b69a-b8d147590701 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:03.070436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-806ba4d5-abf5-4c54-b69a-b8d147590701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:03.078562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3eb98-7d4d-425b-b797-1fdddcc9733e None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.079604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1003/2021] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:03.083666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.083844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ba4d5-abf5-4c54-b69a-b8d147590701 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.084330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.084615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.084916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.086813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:03.093651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ba4d5-abf5-4c54-b69a-b8d147590701 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.099576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.099869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.100406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.100767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.101217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.101387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.102074 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:03.102458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.104363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.113840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1019/2022] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:03.126769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1004/2023] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:21:03.132230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.142184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46170068-fe94-4f07-ab3e-16f1a1da84d2 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.149191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.149869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.150151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.150427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.151134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.153071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.271720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1020/2024] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:03 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:03.276019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.286223 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605701f1-3ac1-454a-b445-40de96858487 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.355699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.356292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.356580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.356959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.357620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.359577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.449134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1005/2025] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:03 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:03.454111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.468459 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948d6b-2443-4c63-ba4a-2c9857dd0f2e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.476379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.476893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.482043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.482043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.482043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.482043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.511015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1021/2026] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:03.516189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.529232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38520ea-bad0-4a67-8e35-c807b2a6c5f1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.535286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.536165 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.536520 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.537249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.540452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.542295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.553985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.555934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:03.590548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0475-db96-4253-a964-d40f2a4ed3e8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.590548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.591329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.591688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.592040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] PATH_INFO: `/v3/projects/cb0a68df569a40d7a70e334c7c010259` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.594271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1006/2027] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:03.594483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0a68df569a40d7a70e334c7c010259)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.598234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.609197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.643318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97fe73-9950-4f0f-b46b-42e8f52197cf admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.652479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69ad25-6c5c-452e-b177-893dcd9f306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.653861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ad25-6c5c-452e-b177-893dcd9f306a admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.655020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ad25-6c5c-452e-b177-893dcd9f306a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.655540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ad25-6c5c-452e-b177-893dcd9f306a admin admin] PATH_INFO: `/v3/projects/b3f56ad3a05943d093d380cc13a24017/users/2437e97b666e423989f44ac92bc18600/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.685315 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69ad25-6c5c-452e-b177-893dcd9f306a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f56ad3a05943d093d380cc13a24017, user_id=2437e97b666e423989f44ac92bc18600, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.691405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69ad25-6c5c-452e-b177-893dcd9f306a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:03.765320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1007/2028] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:03 2022] PUT /identity/v3/projects/b3f56ad3a05943d093d380cc13a24017/users/2437e97b666e423989f44ac92bc18600/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:03.775902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.776227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.776541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.781569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0a68df569a40d7a70e334c7c010259', 'request_id': 'req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:03.809055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] MFA Rules not processed for user `2437e97b666e423989f44ac92bc18600`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:03.810520 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:03.830793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0a68df569a40d7a70e334c7c010259', 'request_id': 'req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:03.837132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0a68df569a40d7a70e334c7c010259', 'request_id': 'req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:03.849980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] The token cache is being invalidate because project cb0a68df569a40d7a70e334c7c010259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:03.850350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:03.851085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:03.853055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1022/2029] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:03 2022] DELETE /identity/v3/projects/cb0a68df569a40d7a70e334c7c010259 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:03.856891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:03.858327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:03.889133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1008/2030] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:03.930089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0aa79-4bfe-4ad7-bbdb-44c28f2d9d0a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:03.934986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:03.936063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:03.945241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:03.945241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] PATH_INFO: `/v3/users/9f039f7ec2394a0b97da4c9e9b1d27e9` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:03.945241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f039f7ec2394a0b97da4c9e9b1d27e9)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:03.945241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:04.128635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f039f7ec2394a0b97da4c9e9b1d27e9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:04.129409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f039f7ec2394a0b97da4c9e9b1d27e9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:04.138766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f039f7ec2394a0b97da4c9e9b1d27e9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:04.152496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f039f7ec2394a0b97da4c9e9b1d27e9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:04.153334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f039f7ec2394a0b97da4c9e9b1d27e9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:04.238362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1023/2031] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:03 2022] DELETE /identity/v3/users/9f039f7ec2394a0b97da4c9e9b1d27e9 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:04.281038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:04.283366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:04.370390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c2de8-0191-48ab-af14-0d90e70a44c0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:04.455257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb5cf2-639d-48ed-985a-f5a9e719e24a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:04.456024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb5cf2-639d-48ed-985a-f5a9e719e24a service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:04.456443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb5cf2-639d-48ed-985a-f5a9e719e24a service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:04.456764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb5cf2-639d-48ed-985a-f5a9e719e24a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:04.459015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-07fb5cf2-639d-48ed-985a-f5a9e719e24a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:04.564744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb5cf2-639d-48ed-985a-f5a9e719e24a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:04.566641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb5cf2-639d-48ed-985a-f5a9e719e24a service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:04.576708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1009/2032] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:04.718528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:04.721532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:04.831070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14537993-deb9-48fe-8eb2-16f255b075b2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:04.838264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:04.839745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:04.840137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:04.840647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] PATH_INFO: `/v3/projects/d057efcaf6b843ffa29eff83705750ab` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:04.842656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d057efcaf6b843ffa29eff83705750ab)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:04.846794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:04.978557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd057efcaf6b843ffa29eff83705750ab', 'request_id': 'req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:05.076107 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd057efcaf6b843ffa29eff83705750ab', 'request_id': 'req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:05.083795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd057efcaf6b843ffa29eff83705750ab', 'request_id': 'req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:05.095304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] The token cache is being invalidate because project d057efcaf6b843ffa29eff83705750ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:05.095904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:05.096415 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-23b46cc7-c244-4fc4-b55f-e7e39fb410bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:05.098054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1024/2033] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:04 2022] DELETE /identity/v3/projects/d057efcaf6b843ffa29eff83705750ab => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:05.102805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a941db-2fba-4e84-b9c1-6dc043c02676 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.103270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a941db-2fba-4e84-b9c1-6dc043c02676 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.103396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a941db-2fba-4e84-b9c1-6dc043c02676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.121395 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e6a941db-2fba-4e84-b9c1-6dc043c02676 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:05.122619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e6a941db-2fba-4e84-b9c1-6dc043c02676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:05.185419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1010/2034] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:05.198642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ed22d-2bbd-476b-8ee0-1f7c6a7568da None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.199052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ed22d-2bbd-476b-8ee0-1f7c6a7568da None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.199344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ed22d-2bbd-476b-8ee0-1f7c6a7568da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.220543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-aa7ed22d-2bbd-476b-8ee0-1f7c6a7568da None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:05.222324 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-aa7ed22d-2bbd-476b-8ee0-1f7c6a7568da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:05.230501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1025/2035] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:05.235225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a941db-2fba-4e84-b9c1-6dc043c02676 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:05.247418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a941db-2fba-4e84-b9c1-6dc043c02676 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:05.252465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:05.253190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.253527 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.253812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.254593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:05.257102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:05.257102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:05.269976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1011/2036] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:05.276887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ed22d-2bbd-476b-8ee0-1f7c6a7568da None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:05.291456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ed22d-2bbd-476b-8ee0-1f7c6a7568da None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:05.297018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:05.298302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.298602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.298885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.299589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:05.301617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:05.369697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1026/2037] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:05 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:05.374132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:05.385641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e1472-8874-4b3e-a02a-5019d3da402b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:05.445459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:05.542180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.542180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.542180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.542180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:05.542180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:05.882191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1012/2038] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:05 2022] POST /identity/v3/users => generated 289 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:05.882904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:05.891663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a4bd0-414d-4de4-96f2-dab1ab48c521 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:05.896214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:05.896868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.897189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.897468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.898190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:05.899840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:05.911544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1027/2039] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:05.915923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:05.927348 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbc20a-0ffb-493c-a627-6539f4343bab admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:05.931943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127dd1-5b1b-4294-804a-04f2d2a08f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:05.932605 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127dd1-5b1b-4294-804a-04f2d2a08f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.932891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127dd1-5b1b-4294-804a-04f2d2a08f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.933225 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127dd1-5b1b-4294-804a-04f2d2a08f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.936829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127dd1-5b1b-4294-804a-04f2d2a08f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:05.936829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127dd1-5b1b-4294-804a-04f2d2a08f38 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:05.945851 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1013/2040] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:05.950040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:05.961540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd22c1-b293-4f27-a7fb-d59f47191e42 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:05.966853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:05.967741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:05.968027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:05.968341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] PATH_INFO: `/v3/projects/7396358abac542beaf777cb411512aa8/users/c8277578891e409e93a1d01c086f3be0/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:05.983398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7396358abac542beaf777cb411512aa8, user_id=c8277578891e409e93a1d01c086f3be0, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:05.986842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:06.076524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1028/2041] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:05 2022] PUT /identity/v3/projects/7396358abac542beaf777cb411512aa8/users/c8277578891e409e93a1d01c086f3be0/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:06.088584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57976ba-184d-485b-8490-c60108c0f2f2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.088872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57976ba-184d-485b-8490-c60108c0f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.089179 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57976ba-184d-485b-8490-c60108c0f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.119418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b57976ba-184d-485b-8490-c60108c0f2f2 None None] MFA Rules not processed for user `c8277578891e409e93a1d01c086f3be0`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:06.120659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b57976ba-184d-485b-8490-c60108c0f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:06.191762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1014/2042] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:06.196761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:06.262626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26875aa-c786-4cea-827c-23e326e72802 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:06.270613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:06.271344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.271619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.271928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.272596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:06.274562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:06.357979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1029/2043] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:06 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:06.362794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57976ba-184d-485b-8490-c60108c0f2f2 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:06.373610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57976ba-184d-485b-8490-c60108c0f2f2 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:06.431020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:06.431703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.431989 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.432268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.432975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:06.434926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:06.534021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1015/2044] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:06 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:06.538599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:06.550388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214cf56-902c-42eb-b897-0da7bc50c5c1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:06.555231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:06.557535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.557535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.557535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.557535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:06.558832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:06.574147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1030/2045] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:06.579173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:06.586707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5adc39-0f6a-48c6-833e-f6be63c456c9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:06.591639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:06.592720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.592838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.593067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] PATH_INFO: `/v3/projects/b2915bcd9b1042a3b9a389f0efd1d6e3/users/dcb6e5e7f9664df29903ff290ddaa1fb/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.610890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2915bcd9b1042a3b9a389f0efd1d6e3, user_id=dcb6e5e7f9664df29903ff290ddaa1fb, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:06.613740 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:06.670407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1016/2046] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:06 2022] PUT /identity/v3/projects/b2915bcd9b1042a3b9a389f0efd1d6e3/users/dcb6e5e7f9664df29903ff290ddaa1fb/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:06.677354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:06.687229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5426-cb11-4942-b82b-bb8a6f36d891 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:06.743295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac44ff-428f-4f53-a368-63b8274e765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:06.743968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac44ff-428f-4f53-a368-63b8274e765c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.744257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac44ff-428f-4f53-a368-63b8274e765c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.744541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac44ff-428f-4f53-a368-63b8274e765c admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.745296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac44ff-428f-4f53-a368-63b8274e765c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:06.746906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac44ff-428f-4f53-a368-63b8274e765c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:06.756690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1031/2047] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:06.760887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:06.771652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fb75d-b562-4012-8838-2e1535077246 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:06.776502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:06.777464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.777741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.778015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] PATH_INFO: `/v3/projects/b2915bcd9b1042a3b9a389f0efd1d6e3/users/dcb6e5e7f9664df29903ff290ddaa1fb/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.780102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2915bcd9b1042a3b9a389f0efd1d6e3, user_id=dcb6e5e7f9664df29903ff290ddaa1fb, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:06.785649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:06.796868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1017/2048] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:06 2022] PUT /identity/v3/projects/b2915bcd9b1042a3b9a389f0efd1d6e3/users/dcb6e5e7f9664df29903ff290ddaa1fb/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:06.807675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d2d2-ff03-4b15-8cf0-7f42f4c0bfbe None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.807973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d2d2-ff03-4b15-8cf0-7f42f4c0bfbe None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.808259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d2d2-ff03-4b15-8cf0-7f42f4c0bfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:06.836666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-13a7d2d2-ff03-4b15-8cf0-7f42f4c0bfbe None None] MFA Rules not processed for user `dcb6e5e7f9664df29903ff290ddaa1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:06.837914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-13a7d2d2-ff03-4b15-8cf0-7f42f4c0bfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:06.903720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1032/2049] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:06.915347 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:06.917046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:06.974060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d667e-b0d8-4dda-bba9-fa3cbe4c8f9c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:06.977788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:06.978435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:06.978718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:06.978995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:07.035495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:07.036924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:07.045786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1018/2050] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:08.419132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbbacf-15aa-4693-9233-12e21226c6e6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:08.425292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbbacf-15aa-4693-9233-12e21226c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:08.425292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbbacf-15aa-4693-9233-12e21226c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:08.438909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0dfbbacf-15aa-4693-9233-12e21226c6e6 None None] MFA Rules not processed for user `2437e97b666e423989f44ac92bc18600`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:08.442520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0dfbbacf-15aa-4693-9233-12e21226c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:08.502074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1033/2051] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:09.532626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:09.534227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:09.654951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69b3cc-24a7-42fb-aad3-ada1250d5270 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:09.666919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:09.671809 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:09.671809 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:09.671809 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] PATH_INFO: `/v3/users/8ce8ac95051f42c1bccc3061e145f093` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:09.671809 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce8ac95051f42c1bccc3061e145f093)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:09.673892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:09.821950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce8ac95051f42c1bccc3061e145f093'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:09.822551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce8ac95051f42c1bccc3061e145f093'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:09.835408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce8ac95051f42c1bccc3061e145f093'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:09.836122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce8ac95051f42c1bccc3061e145f093'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:09.842918 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce8ac95051f42c1bccc3061e145f093'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:09.918297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1019/2052] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:09 2022] DELETE /identity/v3/users/8ce8ac95051f42c1bccc3061e145f093 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:09.921046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:09.921605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:09.921683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:09.942035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:09.943298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:10.006189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1034/2053] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:10.017025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:10.018669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:10.077630 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e830122-cba2-4a7b-8783-f133f63ded19 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:10.081863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:10.082511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:10.082795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:10.083068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:10.092476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:10.094102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:10.105505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1020/2054] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:10.632872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:10.634361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:10.646155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d584d3-4236-4e33-9010-dd335ffb3508 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:10.651323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:10.652870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:10.653260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:10.656229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] PATH_INFO: `/v3/projects/c651141316c94c24802266a0752ad29d` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:10.656229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c651141316c94c24802266a0752ad29d)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:10.658084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:10.763150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c651141316c94c24802266a0752ad29d', 'request_id': 'req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:10.818435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c651141316c94c24802266a0752ad29d', 'request_id': 'req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:10.824326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c651141316c94c24802266a0752ad29d', 'request_id': 'req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:10.835643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] The token cache is being invalidate because project c651141316c94c24802266a0752ad29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:10.835931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:10.836563 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:10.838133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1035/2055] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:10 2022] DELETE /identity/v3/projects/c651141316c94c24802266a0752ad29d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:10.842267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:10.852251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0a87e-d217-49e2-aea7-aa2b830586c2 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:10.906521 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:10.907936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:10.908215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:10.908489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] PATH_INFO: `/v3/users/3556b50eba2f4d53824022166ed2a95b` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:10.909714 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3556b50eba2f4d53824022166ed2a95b)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:10.911628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:11.072640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3556b50eba2f4d53824022166ed2a95b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.073324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3556b50eba2f4d53824022166ed2a95b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.085804 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3556b50eba2f4d53824022166ed2a95b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.086474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3556b50eba2f4d53824022166ed2a95b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.093060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-aadb2942-2f1c-4585-b719-f2c1242780ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3556b50eba2f4d53824022166ed2a95b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.167478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1021/2056] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:10 2022] DELETE /identity/v3/users/3556b50eba2f4d53824022166ed2a95b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:11.595456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:11.597100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:11.611938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8a807-cd30-46d6-b0a7-4ee237d4cb18 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:11.676619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:11.677526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:11.677814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:11.678100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] PATH_INFO: `/v3/projects/6ea4f0ce84b14d37b8f6d994ce08909b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:11.679303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea4f0ce84b14d37b8f6d994ce08909b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:11.681254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:11.779198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea4f0ce84b14d37b8f6d994ce08909b', 'request_id': 'req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.847202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea4f0ce84b14d37b8f6d994ce08909b', 'request_id': 'req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.852990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea4f0ce84b14d37b8f6d994ce08909b', 'request_id': 'req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.865066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] The token cache is being invalidate because project 6ea4f0ce84b14d37b8f6d994ce08909b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:11.865387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.866046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5fcaf6c0-01eb-485f-b25b-fefb0866d05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:11.867576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1036/2057] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:11 2022] DELETE /identity/v3/projects/6ea4f0ce84b14d37b8f6d994ce08909b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:11.875535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ef70-aeb4-4dc9-af90-af695e52e2ba None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:11.876660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ef70-aeb4-4dc9-af90-af695e52e2ba None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:11.876660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922ef70-aeb4-4dc9-af90-af695e52e2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:11.894369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4922ef70-aeb4-4dc9-af90-af695e52e2ba None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:11.895592 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4922ef70-aeb4-4dc9-af90-af695e52e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:11.956421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1022/2058] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:11.964430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570389bd-195b-4429-acb8-2a0f30c3a79b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:11.964750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570389bd-195b-4429-acb8-2a0f30c3a79b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:11.965036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570389bd-195b-4429-acb8-2a0f30c3a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:11.984112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-570389bd-195b-4429-acb8-2a0f30c3a79b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:11.986437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-570389bd-195b-4429-acb8-2a0f30c3a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:11.993991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1037/2059] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:11.998500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ef70-aeb4-4dc9-af90-af695e52e2ba None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:12.008132 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922ef70-aeb4-4dc9-af90-af695e52e2ba None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:12.012746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:12.013430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.013713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.013987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.014738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:12.015040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:12.016668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:12.028244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1023/2060] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:12.033314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570389bd-195b-4429-acb8-2a0f30c3a79b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:12.042561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570389bd-195b-4429-acb8-2a0f30c3a79b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:12.048031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:12.048684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.048967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.049274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.049968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:12.051861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:12.129171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1038/2061] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:12 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:12.133434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:12.144691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d738850-1892-4fde-8281-04a855680e32 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:12.202304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:12.202994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.203283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.204094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.205493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:12.207431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:12.318055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1024/2062] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:12 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:12.322038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:12.332834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b08b4-7671-4c87-bbfe-f84399bc029f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:12.337472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:12.338126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.338417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.338696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.339422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:12.341030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:12.351976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1039/2063] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:12.356189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:12.367615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fbbfd-0e1c-46ef-9fe4-94a68af18a65 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:12.372291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8eac-cee0-4f11-8de5-af1b9cbc8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:12.372955 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8eac-cee0-4f11-8de5-af1b9cbc8287 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.373281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8eac-cee0-4f11-8de5-af1b9cbc8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.373561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8eac-cee0-4f11-8de5-af1b9cbc8287 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.374283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed8eac-cee0-4f11-8de5-af1b9cbc8287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:12.376375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed8eac-cee0-4f11-8de5-af1b9cbc8287 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:12.390008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1025/2064] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:12.392129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:12.403722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5a837-6813-4bd0-a41c-2f3a076193a0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:12.409329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:12.410244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.410524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.410797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] PATH_INFO: `/v3/projects/65b8359d2c5e4c549f22c684215e2af2/users/cfdc5197e8c94f0786d0f63fd8c3fdac/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.426875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b8359d2c5e4c549f22c684215e2af2, user_id=cfdc5197e8c94f0786d0f63fd8c3fdac, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:12.429631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:12.505767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1040/2065] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:12 2022] PUT /identity/v3/projects/65b8359d2c5e4c549f22c684215e2af2/users/cfdc5197e8c94f0786d0f63fd8c3fdac/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:12.517752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.518067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.518326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.549908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] MFA Rules not processed for user `cfdc5197e8c94f0786d0f63fd8c3fdac`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:12.551224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:12.633143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1026/2066] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:12.640549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:12.643786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:12.712151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3d21-72c8-4380-83f1-c89b2173204a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:12.716322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:12.717250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:12.717589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:12.718028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:12.727523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:12.728980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:12.738818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1041/2067] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:13.634008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:13.635448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:13.647611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088cff3-86dd-4f0c-a865-71c5b51b3180 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:13.651178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebec9e0-bb4d-4b88-abd9-4dbc69fd80ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:13.651863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec9e0-bb4d-4b88-abd9-4dbc69fd80ee service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:13.652146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec9e0-bb4d-4b88-abd9-4dbc69fd80ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:13.652420 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec9e0-bb4d-4b88-abd9-4dbc69fd80ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:13.654410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-aebec9e0-bb4d-4b88-abd9-4dbc69fd80ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:13.743342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec9e0-bb4d-4b88-abd9-4dbc69fd80ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:13.744827 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec9e0-bb4d-4b88-abd9-4dbc69fd80ee service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:13.756288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1027/2068] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:16.089289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:16.092406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:16.190995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc287ab8-7f15-4a7c-b8af-f5f1da2f5ae5 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:16.198423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:16.199343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:16.199629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:16.199909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] PATH_INFO: `/v3/users/a8eb096cf2c04b4db0ed9c7f71beae9e` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:16.201863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8eb096cf2c04b4db0ed9c7f71beae9e)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:16.204326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:16.416350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8eb096cf2c04b4db0ed9c7f71beae9e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:16.417246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8eb096cf2c04b4db0ed9c7f71beae9e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:16.426254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8eb096cf2c04b4db0ed9c7f71beae9e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:16.441532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8eb096cf2c04b4db0ed9c7f71beae9e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:16.442301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8eb096cf2c04b4db0ed9c7f71beae9e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:16.538819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1042/2069] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:16 2022] DELETE /identity/v3/users/a8eb096cf2c04b4db0ed9c7f71beae9e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:16.543377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:16.543867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:16.543867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:16.561584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:16.562711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:16.622087 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1028/2070] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:16.632560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:16.633995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:16.691479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7380-be44-48b4-b52d-a4c761191001 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:16.695202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:16.695873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:16.696159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:16.696443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:16.706775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:16.708321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:16.718829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1043/2071] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:17.135158 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:17.137029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:17.154770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f499c-a034-46b9-8cba-038f4e83ef35 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:17.154926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:17.155675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:17.155959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:17.156235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] PATH_INFO: `/v3/projects/69b35d149a88415aa4b03267e9472c81` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:17.158076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b35d149a88415aa4b03267e9472c81)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:17.160012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:17.284759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b35d149a88415aa4b03267e9472c81', 'request_id': 'req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.412910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b35d149a88415aa4b03267e9472c81', 'request_id': 'req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.418947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b35d149a88415aa4b03267e9472c81', 'request_id': 'req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.430256 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] The token cache is being invalidate because project 69b35d149a88415aa4b03267e9472c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:17.430541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.431183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.432855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1029/2072] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:17 2022] DELETE /identity/v3/projects/69b35d149a88415aa4b03267e9472c81 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:17.436980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:17.447267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d9145-4b0b-4ad4-98fb-2a5eae528588 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:17.508565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:17.509471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:17.509759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:17.510022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] PATH_INFO: `/v3/users/3c27b01a4432403aa14f15b33e21e31f` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:17.511218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c27b01a4432403aa14f15b33e21e31f)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:17.513160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:17.695657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c27b01a4432403aa14f15b33e21e31f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.696247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c27b01a4432403aa14f15b33e21e31f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.703387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c27b01a4432403aa14f15b33e21e31f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.715539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c27b01a4432403aa14f15b33e21e31f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.716194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-5ee92eab-624f-45e2-a974-ae67ace535bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c27b01a4432403aa14f15b33e21e31f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:17.801546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1044/2073] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:17 2022] DELETE /identity/v3/users/3c27b01a4432403aa14f15b33e21e31f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:18.311869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:18.314676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:18.345960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf5d37-c4e7-49ee-a30c-c0f2ec204fdc admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:18.406425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:18.408051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:18.408330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:18.408604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] PATH_INFO: `/v3/projects/a28ece692c624dfda670785ee4e51a0a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:18.409798 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28ece692c624dfda670785ee4e51a0a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:18.411685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:18.545154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28ece692c624dfda670785ee4e51a0a', 'request_id': 'req-91fc7a2e-2d12-456d-bca8-81e5bff46d85'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:18.659378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28ece692c624dfda670785ee4e51a0a', 'request_id': 'req-91fc7a2e-2d12-456d-bca8-81e5bff46d85'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:18.667383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28ece692c624dfda670785ee4e51a0a', 'request_id': 'req-91fc7a2e-2d12-456d-bca8-81e5bff46d85'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:18.681697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] The token cache is being invalidate because project a28ece692c624dfda670785ee4e51a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:18.682218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:18.682945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-91fc7a2e-2d12-456d-bca8-81e5bff46d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:18.688977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1030/2074] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:18 2022] DELETE /identity/v3/projects/a28ece692c624dfda670785ee4e51a0a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:18.690806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07685-07e7-4fb1-bac4-6ea932518874 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:18.691249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07685-07e7-4fb1-bac4-6ea932518874 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:18.691489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07685-07e7-4fb1-bac4-6ea932518874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:18.714698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f7e07685-07e7-4fb1-bac4-6ea932518874 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:18.720375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f7e07685-07e7-4fb1-bac4-6ea932518874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:18.795318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1045/2075] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:18.801901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6f2e-5b80-4e37-9e17-275425a9d4a6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:18.802344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6f2e-5b80-4e37-9e17-275425a9d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:18.802705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6f2e-5b80-4e37-9e17-275425a9d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:18.822990 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-695e6f2e-5b80-4e37-9e17-275425a9d4a6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:18.824294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-695e6f2e-5b80-4e37-9e17-275425a9d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:18.837154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1031/2076] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:18.841241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e07685-07e7-4fb1-bac4-6ea932518874 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:18.851958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e07685-07e7-4fb1-bac4-6ea932518874 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:18.856900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:18.857632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:18.857917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:18.858192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:18.858922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:18.859263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:18.861493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:18.874148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1046/2077] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:18.878966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e6f2e-5b80-4e37-9e17-275425a9d4a6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:18.888240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e6f2e-5b80-4e37-9e17-275425a9d4a6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:18.893816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:18.894519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:18.894811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:18.895083 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:18.895774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:18.897772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:18.979510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1032/2078] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:18 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:18.984068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:18.995897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e2ce-743f-4a4c-85bb-ac971f143009 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.065373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.066085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.066368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.066642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.067381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.069380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:19.146137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1047/2079] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:18 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:19.150387 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:19.161616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63ff19-6828-46b0-bcee-a026a3c598ed admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.166397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.167100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.167390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.167675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.168402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.170175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:19.181510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1033/2080] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:19.185489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:19.196576 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2f35c-dad2-40f9-8323-7043b07f0274 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.205779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8cf4c-094f-4cfb-b794-2fccc6117ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.206894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cf4c-094f-4cfb-b794-2fccc6117ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.207395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cf4c-094f-4cfb-b794-2fccc6117ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.207911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8cf4c-094f-4cfb-b794-2fccc6117ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.209354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8cf4c-094f-4cfb-b794-2fccc6117ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.212604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8cf4c-094f-4cfb-b794-2fccc6117ff1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:19.226008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1048/2081] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:19.230104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:19.240998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599f6d9-0fd0-415d-a3a9-68d8b9177f55 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.246027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.246977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.247264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.247542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] PATH_INFO: `/v3/projects/d0dcff23bf8d43d58eeabe78f61203ce/users/9e76fd646c484d50b08e4e3f32208305/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.264899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0dcff23bf8d43d58eeabe78f61203ce, user_id=9e76fd646c484d50b08e4e3f32208305, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.268756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:19.339789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1034/2082] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:19 2022] PUT /identity/v3/projects/d0dcff23bf8d43d58eeabe78f61203ce/users/9e76fd646c484d50b08e4e3f32208305/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:19.351513 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5e3f-5dcf-4f85-ab2c-0de5c7dcca06 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.352117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5e3f-5dcf-4f85-ab2c-0de5c7dcca06 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.352393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe5e3f-5dcf-4f85-ab2c-0de5c7dcca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.391989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6fbe5e3f-5dcf-4f85-ab2c-0de5c7dcca06 None None] MFA Rules not processed for user `9e76fd646c484d50b08e4e3f32208305`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:19.393428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6fbe5e3f-5dcf-4f85-ab2c-0de5c7dcca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:19.476346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1049/2083] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:19.480784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:19.546631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13420d9e-4a5c-4744-92bd-8db9a8a71057 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.552585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.553296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.553669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.553999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.554756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.556714 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:19.654847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1035/2084] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:19 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:19.666750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe5e3f-5dcf-4f85-ab2c-0de5c7dcca06 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:19.677958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe5e3f-5dcf-4f85-ab2c-0de5c7dcca06 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.736647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.737401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.737694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.737968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.738684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.740654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:19.847877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1050/2085] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:19 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:19.851870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:19.862906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ebca5-e3d3-4382-809e-a39688dc6a86 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.867345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.868018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.868304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.868580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.869344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.871057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:19.882302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1036/2086] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:19.886786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:19.900539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28866a-eab9-4e21-aee4-75a4b9b20004 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:19.906187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:19.907575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:19.907861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:19.908140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] PATH_INFO: `/v3/projects/53a0d5097e5842f7a54df0ef15bb7670/users/e6d623110f1841e594edd7a7503dec22/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:19.924467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a0d5097e5842f7a54df0ef15bb7670, user_id=e6d623110f1841e594edd7a7503dec22, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:19.927349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:20.049931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1051/2087] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:19 2022] PUT /identity/v3/projects/53a0d5097e5842f7a54df0ef15bb7670/users/e6d623110f1841e594edd7a7503dec22/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:20.061610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:20.073012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eb0d9-5e46-4726-9ed2-121e58c3cf48 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:20.142438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bb951-3a1a-451a-8ff0-5aa6fee72580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:20.143529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb951-3a1a-451a-8ff0-5aa6fee72580 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:20.143937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb951-3a1a-451a-8ff0-5aa6fee72580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:20.144286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb951-3a1a-451a-8ff0-5aa6fee72580 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:20.145338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bb951-3a1a-451a-8ff0-5aa6fee72580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:20.147054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bb951-3a1a-451a-8ff0-5aa6fee72580 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:20.158900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1037/2088] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:20.165357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:20.179253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6181c-72fc-43a4-994d-166994dd9a4a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:20.184388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:20.185470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:20.187054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:20.187054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] PATH_INFO: `/v3/projects/53a0d5097e5842f7a54df0ef15bb7670/users/e6d623110f1841e594edd7a7503dec22/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:20.188280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a0d5097e5842f7a54df0ef15bb7670, user_id=e6d623110f1841e594edd7a7503dec22, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:20.191213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:20.203396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1052/2089] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:20 2022] PUT /identity/v3/projects/53a0d5097e5842f7a54df0ef15bb7670/users/e6d623110f1841e594edd7a7503dec22/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:20.214598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676847e-7662-4615-a928-9e703d746d74 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:20.214891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676847e-7662-4615-a928-9e703d746d74 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:20.215163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676847e-7662-4615-a928-9e703d746d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:20.248264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6676847e-7662-4615-a928-9e703d746d74 None None] MFA Rules not processed for user `e6d623110f1841e594edd7a7503dec22`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:20.250451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6676847e-7662-4615-a928-9e703d746d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:20.338725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1038/2090] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:20.352363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:20.354706 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:20.417721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e829ec9-abfc-4694-8beb-025a81b90613 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:20.421817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8b850-5d0b-4459-a465-9dbabb71e23c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:20.422515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b850-5d0b-4459-a465-9dbabb71e23c service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:20.422802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b850-5d0b-4459-a465-9dbabb71e23c service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:20.423138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8b850-5d0b-4459-a465-9dbabb71e23c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:20.433272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8b850-5d0b-4459-a465-9dbabb71e23c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:20.434739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8b850-5d0b-4459-a465-9dbabb71e23c service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:20.445559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1053/2091] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:20.474742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676847e-7662-4615-a928-9e703d746d74 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:20.540653 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676847e-7662-4615-a928-9e703d746d74 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:20.545715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:20.546610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:20.546896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:20.547171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] PATH_INFO: `/v3/users/9e76fd646c484d50b08e4e3f32208305` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:20.548454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e76fd646c484d50b08e4e3f32208305)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:20.550397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:20.775696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e76fd646c484d50b08e4e3f32208305'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:20.776410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e76fd646c484d50b08e4e3f32208305'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:20.789869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e76fd646c484d50b08e4e3f32208305'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:20.790609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e76fd646c484d50b08e4e3f32208305'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:20.797279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e76fd646c484d50b08e4e3f32208305'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:20.847627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1039/2092] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:20 2022] DELETE /identity/v3/users/9e76fd646c484d50b08e4e3f32208305 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:20.852826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:20.853386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:20.853386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:20.870866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:20.872083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:20.933776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1054/2093] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:20.944258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:20.945723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:21.009736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61309547-b206-4726-aa6a-681c433c40a5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:21.013541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:21.014196 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:21.014485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:21.014766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:21.026494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:21.027999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:21.038766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1040/2094] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:21.555155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:21.557742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:21.579367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58671b-8799-4a1f-a088-352682275aa7 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:21.585116 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:21.585986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:21.586425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:21.586844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] PATH_INFO: `/v3/projects/d0dcff23bf8d43d58eeabe78f61203ce` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:21.589106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0dcff23bf8d43d58eeabe78f61203ce)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:21.598143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:21.865795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0dcff23bf8d43d58eeabe78f61203ce', 'request_id': 'req-afb3ae49-9baa-4a03-8261-6b9c7044737f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:21.973831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0dcff23bf8d43d58eeabe78f61203ce', 'request_id': 'req-afb3ae49-9baa-4a03-8261-6b9c7044737f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:21.981926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0dcff23bf8d43d58eeabe78f61203ce', 'request_id': 'req-afb3ae49-9baa-4a03-8261-6b9c7044737f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:21.994994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] The token cache is being invalidate because project d0dcff23bf8d43d58eeabe78f61203ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:21.995282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:21.995937 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:21.997832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1055/2095] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:21 2022] DELETE /identity/v3/projects/d0dcff23bf8d43d58eeabe78f61203ce => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:22.001917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:22.013757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf7381-61ea-43a6-8cb2-49f29ca3a0a6 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:22.074840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:22.075721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:22.076008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:22.076541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] PATH_INFO: `/v3/users/e6d623110f1841e594edd7a7503dec22` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:22.077784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d623110f1841e594edd7a7503dec22)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:22.080591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:22.217413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d623110f1841e594edd7a7503dec22'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:22.218091 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d623110f1841e594edd7a7503dec22'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:22.240047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d623110f1841e594edd7a7503dec22'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:22.240862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d623110f1841e594edd7a7503dec22'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:22.249815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-624f32c8-fe4f-4402-ad1d-df61f884815c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d623110f1841e594edd7a7503dec22'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:22.317048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1041/2096] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:22 2022] DELETE /identity/v3/users/e6d623110f1841e594edd7a7503dec22 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:22.734481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:22.736072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:22.751379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3ae49-9baa-4a03-8261-6b9c7044737f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:22.829424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:22.830292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:22.830573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:22.830844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] PATH_INFO: `/v3/projects/53a0d5097e5842f7a54df0ef15bb7670` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:22.832015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a0d5097e5842f7a54df0ef15bb7670)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:22.834013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:22.941064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a0d5097e5842f7a54df0ef15bb7670', 'request_id': 'req-3ec588b9-0cea-4120-b151-f6bc205bb464'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:23.002800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a0d5097e5842f7a54df0ef15bb7670', 'request_id': 'req-3ec588b9-0cea-4120-b151-f6bc205bb464'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:23.008957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a0d5097e5842f7a54df0ef15bb7670', 'request_id': 'req-3ec588b9-0cea-4120-b151-f6bc205bb464'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:23.022230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] The token cache is being invalidate because project 53a0d5097e5842f7a54df0ef15bb7670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:23.022528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:23.023289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3ec588b9-0cea-4120-b151-f6bc205bb464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:23.024841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1056/2097] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:22 2022] DELETE /identity/v3/projects/53a0d5097e5842f7a54df0ef15bb7670 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:23.030151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067f01-ac7e-4b24-8858-270e881eb1cb None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.030628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067f01-ac7e-4b24-8858-270e881eb1cb None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.030718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067f01-ac7e-4b24-8858-270e881eb1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.054577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-41067f01-ac7e-4b24-8858-270e881eb1cb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:23.055794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-41067f01-ac7e-4b24-8858-270e881eb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:23.130837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1042/2098] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:23.138676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc054c-6859-418d-827c-1c80ea2e71ab None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.138908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc054c-6859-418d-827c-1c80ea2e71ab None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.139190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc054c-6859-418d-827c-1c80ea2e71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.164470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-35fc054c-6859-418d-827c-1c80ea2e71ab None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:23.166032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-35fc054c-6859-418d-827c-1c80ea2e71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:23.175081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1057/2099] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:23.179633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41067f01-ac7e-4b24-8858-270e881eb1cb None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.190756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41067f01-ac7e-4b24-8858-270e881eb1cb None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:23.195901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:23.196581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.196868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.197269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.197997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:23.198414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:23.200117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:23.213110 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1043/2100] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:23.217699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc054c-6859-418d-827c-1c80ea2e71ab None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.228180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc054c-6859-418d-827c-1c80ea2e71ab None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:23.232901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:23.233590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.233876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.234152 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.235660 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:23.237628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:23.307397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1058/2101] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:23 2022] POST /identity/v3/projects => generated 401 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:23.318342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.330170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d595-5dff-4cf2-9b41-6fa0e65cf3da admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:23.391905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:23.392846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.393189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.393543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.394457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:23.396729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:23.464503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1044/2102] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:23 2022] POST /identity/v3/users => generated 301 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:23.468990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.480118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239ce86-6486-441b-9d96-508a42e4fe8a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:23.484723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:23.485589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.485865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.486137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.486858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:23.488441 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:23.504216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1059/2103] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:23.506954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.517501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e007e0c-8759-44c1-b067-ba17b93d52d7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:23.522219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e77d9-fdb2-45ba-af0a-dfef1d0618aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:23.522817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e77d9-fdb2-45ba-af0a-dfef1d0618aa admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.523098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e77d9-fdb2-45ba-af0a-dfef1d0618aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.523392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e77d9-fdb2-45ba-af0a-dfef1d0618aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.524105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e77d9-fdb2-45ba-af0a-dfef1d0618aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:23.525718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e77d9-fdb2-45ba-af0a-dfef1d0618aa admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:23.536954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1045/2104] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:23.541147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.551346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55290598-8d22-403f-bfc3-f8125dc31d73 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:23.556202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:23.557121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.557416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.557749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] PATH_INFO: `/v3/projects/a553701564044efa8162e085d0d7a4d8/users/ffc6ba9e14894550afc44ffd20397dad/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.573639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a553701564044efa8162e085d0d7a4d8, user_id=ffc6ba9e14894550afc44ffd20397dad, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:23.576609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:23.671087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1060/2105] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:23 2022] PUT /identity/v3/projects/a553701564044efa8162e085d0d7a4d8/users/ffc6ba9e14894550afc44ffd20397dad/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:23.682484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eaaab-a887-490e-8e85-08024aa83bd0 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.682778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eaaab-a887-490e-8e85-08024aa83bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.683060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eaaab-a887-490e-8e85-08024aa83bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.712584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4b2eaaab-a887-490e-8e85-08024aa83bd0 None None] MFA Rules not processed for user `ffc6ba9e14894550afc44ffd20397dad`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:23.713837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4b2eaaab-a887-490e-8e85-08024aa83bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:23.778177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1046/2106] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:23.782868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.854784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78545008-3fe2-4ac0-9a15-e5a9b67efe37 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:23.865277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:23.865953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:23.866239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:23.866516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:23.867213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:23.869129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:23.972211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1061/2107] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:23 2022] POST /identity/v3/projects => generated 401 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:23.976598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eaaab-a887-490e-8e85-08024aa83bd0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:23.989861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eaaab-a887-490e-8e85-08024aa83bd0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.060283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.061474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.061956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.062360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.064229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.067690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.209684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1047/2108] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:23 2022] POST /identity/v3/users => generated 307 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:24.210969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:24.222672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0240b-06f9-42fb-a9cc-bf0bb62d266b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.228254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.229260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.229741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.230176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.231150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.232969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.247060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1062/2109] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:24.252713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:24.264476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577b429-f0ba-4619-aedf-3f280e013328 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.269712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.270612 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.270890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.271167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] PATH_INFO: `/v3/projects/829c6373f2784613a8c82bf4b32363bb/users/51256b72abc24da4bc5bbd780002c11c/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.290585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829c6373f2784613a8c82bf4b32363bb, user_id=51256b72abc24da4bc5bbd780002c11c, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.293830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.355748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:24.360559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:24.379430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1048/2110] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:24 2022] PUT /identity/v3/projects/829c6373f2784613a8c82bf4b32363bb/users/51256b72abc24da4bc5bbd780002c11c/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:24.379720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac6c6c-af95-4b12-9a40-cdb907fc7573 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.383535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:24.445361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.448929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.448929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.448929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] PATH_INFO: `/v3/users/bc7ae0c2411a42719506632ca438ee56` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.448929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7ae0c2411a42719506632ca438ee56)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.449884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e911e4-0928-477d-a6cd-dfdd08856a29 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.451532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.457315 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.458006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.458322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.458603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.459350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.460952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.477292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1049/2111] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:24.482814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:24.493620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c388f7-7d5b-4ac0-8c69-448b98ac4d0d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.498831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98deeaf1-a7c3-4779-9c45-131771e05093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.499897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deeaf1-a7c3-4779-9c45-131771e05093 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.500184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deeaf1-a7c3-4779-9c45-131771e05093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.501355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deeaf1-a7c3-4779-9c45-131771e05093 admin admin] PATH_INFO: `/v3/projects/829c6373f2784613a8c82bf4b32363bb/users/51256b72abc24da4bc5bbd780002c11c/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.503568 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98deeaf1-a7c3-4779-9c45-131771e05093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829c6373f2784613a8c82bf4b32363bb, user_id=51256b72abc24da4bc5bbd780002c11c, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.506477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98deeaf1-a7c3-4779-9c45-131771e05093 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.518297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1050/2112] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:24 2022] PUT /identity/v3/projects/829c6373f2784613a8c82bf4b32363bb/users/51256b72abc24da4bc5bbd780002c11c/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:24.529689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.529980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.530261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.562059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] MFA Rules not processed for user `51256b72abc24da4bc5bbd780002c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:24.564253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:24.617273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7ae0c2411a42719506632ca438ee56'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:24.618314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7ae0c2411a42719506632ca438ee56'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:24.627232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7ae0c2411a42719506632ca438ee56'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:24.636274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1051/2113] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:24.640490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7ae0c2411a42719506632ca438ee56'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:24.641855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3d77860e-2b75-41bb-936d-a62a0ec6667f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7ae0c2411a42719506632ca438ee56'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:24.646848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:24.648671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:24.714412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1063/2114] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:24 2022] DELETE /identity/v3/users/bc7ae0c2411a42719506632ca438ee56 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:24.715852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee9afb-50d4-439d-b1e9-341fa0e88cd8 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.718848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.719255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.719825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.741035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:24.742461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:24.769005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.770059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.770589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.771136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.807402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1064/2115] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:24.817840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:24.819864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:24.839382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.840836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.852417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1052/2116] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:24.918211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1856fd-d6e4-499d-a143-d311d74922b7 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:24.922008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:24.922674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:24.922956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:24.923230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:24.932709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:24.934457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:24.944908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1065/2117] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:25.075656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:25.086584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d02ab-665b-428d-8e16-2e5c2405ae38 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:25.090791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:25.091470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:25.091763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:25.092044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:25.093840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:25.170006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:25.172650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:25.191852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1053/2118] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:25.378552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:25.380057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:25.402676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accf496-fc70-4a3e-8702-092656f3eb9b service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:25.410876 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:25.412790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:25.413341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:25.413844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] PATH_INFO: `/v3/projects/ed90722d6bfa4645b4543437cc5d8513` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:25.415985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed90722d6bfa4645b4543437cc5d8513)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:25.419638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:25.547990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed90722d6bfa4645b4543437cc5d8513', 'request_id': 'req-328e57d2-aa80-437a-9573-9e79b672c1bd'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.642215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed90722d6bfa4645b4543437cc5d8513', 'request_id': 'req-328e57d2-aa80-437a-9573-9e79b672c1bd'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.648103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed90722d6bfa4645b4543437cc5d8513', 'request_id': 'req-328e57d2-aa80-437a-9573-9e79b672c1bd'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.660530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] The token cache is being invalidate because project ed90722d6bfa4645b4543437cc5d8513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:25.660847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.661582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.664590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1066/2119] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:25 2022] DELETE /identity/v3/projects/ed90722d6bfa4645b4543437cc5d8513 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:25.668865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:25.680668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b9a97-c805-4a4b-b40f-ce42ccc356a5 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:25.742935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:25.743766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:25.744076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:25.744344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] PATH_INFO: `/v3/users/6b7d5f996fbc423eaa3688ef6a98d5d9` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:25.745616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7d5f996fbc423eaa3688ef6a98d5d9)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:25.747522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:25.960084 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7d5f996fbc423eaa3688ef6a98d5d9'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.960905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7d5f996fbc423eaa3688ef6a98d5d9'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.980333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7d5f996fbc423eaa3688ef6a98d5d9'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.981313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7d5f996fbc423eaa3688ef6a98d5d9'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:25.993248 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b18a0820-6b61-41ac-95b6-c01cc2182cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7d5f996fbc423eaa3688ef6a98d5d9'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:26.225773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1054/2120] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:25 2022] DELETE /identity/v3/users/6b7d5f996fbc423eaa3688ef6a98d5d9 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:26.701568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:26.703211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:26.718600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e57d2-aa80-437a-9573-9e79b672c1bd admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:26.790476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:26.790476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:26.790476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:26.790476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] PATH_INFO: `/v3/projects/9e0bd4ddaabc45b1843611a2e1b94fe1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:26.791237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0bd4ddaabc45b1843611a2e1b94fe1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:26.793253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:26.920669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0bd4ddaabc45b1843611a2e1b94fe1', 'request_id': 'req-abbe0e01-34e6-462d-9387-357520b03fbc'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:27.007710 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0bd4ddaabc45b1843611a2e1b94fe1', 'request_id': 'req-abbe0e01-34e6-462d-9387-357520b03fbc'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:27.013868 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0bd4ddaabc45b1843611a2e1b94fe1', 'request_id': 'req-abbe0e01-34e6-462d-9387-357520b03fbc'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:27.027005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] The token cache is being invalidate because project 9e0bd4ddaabc45b1843611a2e1b94fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:27.027289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:27.027961 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-abbe0e01-34e6-462d-9387-357520b03fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:27.029704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1067/2121] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:26 2022] DELETE /identity/v3/projects/9e0bd4ddaabc45b1843611a2e1b94fe1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:27.035402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407159b-62eb-432f-b4cf-96f60c61e945 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.035690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407159b-62eb-432f-b4cf-96f60c61e945 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.035970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407159b-62eb-432f-b4cf-96f60c61e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.054057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0407159b-62eb-432f-b4cf-96f60c61e945 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:27.055188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0407159b-62eb-432f-b4cf-96f60c61e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:27.117681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1055/2122] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:27.125336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c03f6-4ad0-4c3c-9844-e00ba3ed31d3 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.125735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c03f6-4ad0-4c3c-9844-e00ba3ed31d3 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.126082 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c03f6-4ad0-4c3c-9844-e00ba3ed31d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.146098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9f4c03f6-4ad0-4c3c-9844-e00ba3ed31d3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:27.147327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9f4c03f6-4ad0-4c3c-9844-e00ba3ed31d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:27.155721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1068/2123] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:27.160877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407159b-62eb-432f-b4cf-96f60c61e945 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.170917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407159b-62eb-432f-b4cf-96f60c61e945 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:27.177113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:27.177966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.178271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.178551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.179284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:27.179624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:27.181238 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:27.197575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1056/2124] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:27.202661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c03f6-4ad0-4c3c-9844-e00ba3ed31d3 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.213338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c03f6-4ad0-4c3c-9844-e00ba3ed31d3 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:27.218746 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:27.224808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.224808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.224808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.224808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:27.224808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:27.294263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1069/2125] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:27 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:27.299168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.310133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c137e3-bc3e-4093-a603-bd7d48a14321 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:27.369706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:27.370384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.370670 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.370950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.371642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:27.373600 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:27.464373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1057/2126] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:27 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:27.465874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.477584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ed928-33e1-47e1-8154-204582333442 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:27.482662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:27.483341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.483659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.483933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.484667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:27.487049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:27.498436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1070/2127] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:27.507721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.517882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b2804-ae56-4a5f-9e0c-6db40c4f0f74 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:27.523741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3fa96-6737-42e2-bf7b-ef55bd7f754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:27.524525 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3fa96-6737-42e2-bf7b-ef55bd7f754d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.524967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3fa96-6737-42e2-bf7b-ef55bd7f754d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.525367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3fa96-6737-42e2-bf7b-ef55bd7f754d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.526235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3fa96-6737-42e2-bf7b-ef55bd7f754d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:27.528029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3fa96-6737-42e2-bf7b-ef55bd7f754d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:27.540427 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1058/2128] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:27.543879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.555239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2e9b-f571-4a8a-a423-83b01365435a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:27.562514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:27.563419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.563694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.564073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] PATH_INFO: `/v3/projects/7d869c0c8d454a638bd1406ed4301abb/users/f7d0310f4a4d42b38d0a1d50419bfaed/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.579439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d869c0c8d454a638bd1406ed4301abb, user_id=f7d0310f4a4d42b38d0a1d50419bfaed, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:27.582158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:27.648005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1071/2129] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:27 2022] PUT /identity/v3/projects/7d869c0c8d454a638bd1406ed4301abb/users/f7d0310f4a4d42b38d0a1d50419bfaed/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:27.659482 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9d48-d7d0-45d4-9a95-120dae3ed2cb None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.659776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9d48-d7d0-45d4-9a95-120dae3ed2cb None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.660065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9d48-d7d0-45d4-9a95-120dae3ed2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.689094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-138e9d48-d7d0-45d4-9a95-120dae3ed2cb None None] MFA Rules not processed for user `f7d0310f4a4d42b38d0a1d50419bfaed`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:27.690351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-138e9d48-d7d0-45d4-9a95-120dae3ed2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:27.758023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1059/2130] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:27.762437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.823885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf806bfb-8441-40ca-80a3-1c4c79efac6b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:27.829519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:27.830182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:27.830466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:27.830744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:27.831444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:27.833381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:27.900100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1072/2131] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:27 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:27.904050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9d48-d7d0-45d4-9a95-120dae3ed2cb None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:27.919003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9d48-d7d0-45d4-9a95-120dae3ed2cb None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:28.000060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:28.001343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.001343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.001492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.002204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:28.004152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:28.071406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1060/2132] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:27 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:28.075741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:28.088165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f583a0-6a2e-41d3-9c10-2ee6319b4949 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:28.093190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:28.093834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.094162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.095158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.095896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:28.097528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:28.109336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1073/2133] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:28.113959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:28.124674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc529508-d650-48cf-bf6b-59f3a2e35336 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:28.134682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:28.135788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.136183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.136554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] PATH_INFO: `/v3/projects/0bba95d2c2ea48e8b53dda0eed856528/users/d254a1d3f1b14f1c819d1a669a217ebb/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.152693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bba95d2c2ea48e8b53dda0eed856528, user_id=d254a1d3f1b14f1c819d1a669a217ebb, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:28.155399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:28.257569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1061/2134] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:28 2022] PUT /identity/v3/projects/0bba95d2c2ea48e8b53dda0eed856528/users/d254a1d3f1b14f1c819d1a669a217ebb/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:28.258440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:28.269934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82920d6f-0a19-427b-b9e6-76effc0bb0e6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:28.329589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee968-6710-409f-801d-c2ec3ab173d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:28.329962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee968-6710-409f-801d-c2ec3ab173d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.330874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee968-6710-409f-801d-c2ec3ab173d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.331290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee968-6710-409f-801d-c2ec3ab173d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.332112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ee968-6710-409f-801d-c2ec3ab173d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:28.333881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ee968-6710-409f-801d-c2ec3ab173d8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:28.346200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1074/2135] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:28.350994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:28.362712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55c3b-aae2-4539-a91f-1dd6d9d60f63 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:28.367666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:28.368579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.368843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.369152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] PATH_INFO: `/v3/projects/0bba95d2c2ea48e8b53dda0eed856528/users/d254a1d3f1b14f1c819d1a669a217ebb/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.371131 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bba95d2c2ea48e8b53dda0eed856528, user_id=d254a1d3f1b14f1c819d1a669a217ebb, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:28.373837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:28.385699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1062/2136] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:28 2022] PUT /identity/v3/projects/0bba95d2c2ea48e8b53dda0eed856528/users/d254a1d3f1b14f1c819d1a669a217ebb/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:28.396915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5b435-17c8-4904-83cb-587e4363df33 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.397242 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5b435-17c8-4904-83cb-587e4363df33 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.397520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5b435-17c8-4904-83cb-587e4363df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.425008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-48a5b435-17c8-4904-83cb-587e4363df33 None None] MFA Rules not processed for user `d254a1d3f1b14f1c819d1a669a217ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:28.426464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-48a5b435-17c8-4904-83cb-587e4363df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:28.496682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1075/2137] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:28.506739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:28.508401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:28.565297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0731fb1-ec51-4973-9d82-00496d46e557 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:28.569066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:28.569743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.570027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.570303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.586603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:28.586603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:28.591890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1063/2138] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:28.801795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5b435-17c8-4904-83cb-587e4363df33 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:28.811913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5b435-17c8-4904-83cb-587e4363df33 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:28.816777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:28.817458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:28.817748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:28.818034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:28.873818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:28.875166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:28.884265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1076/2139] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:29.792582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:29.794242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:29.861983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa640-8e69-4fc0-9bc2-9fd951fc241e service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:29.866953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:29.867824 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:29.868111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:29.868488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] PATH_INFO: `/v3/users/a3c5aec16fa247608455d563967032a0` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:29.869712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c5aec16fa247608455d563967032a0)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:29.871621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:30.043914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c5aec16fa247608455d563967032a0'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.044557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c5aec16fa247608455d563967032a0'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.058433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c5aec16fa247608455d563967032a0'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.059228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c5aec16fa247608455d563967032a0'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.067011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-527a151b-e124-4ebf-bb52-3bbd5c066d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c5aec16fa247608455d563967032a0'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.127635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1064/2140] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:29 2022] DELETE /identity/v3/users/a3c5aec16fa247608455d563967032a0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:30.392333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:30.403982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3008f50-bbad-4e23-af99-d0cc3479ef02 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:30.472287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:30.473199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:30.473485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:30.473760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] PATH_INFO: `/v3/projects/e505f411abb9430fb6dc82bf7c802903` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:30.475011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e505f411abb9430fb6dc82bf7c802903)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:30.477272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:30.597413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e505f411abb9430fb6dc82bf7c802903', 'request_id': 'req-0416c128-da46-4e89-b236-fe1393c132bb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.647085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e505f411abb9430fb6dc82bf7c802903', 'request_id': 'req-0416c128-da46-4e89-b236-fe1393c132bb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.653731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e505f411abb9430fb6dc82bf7c802903', 'request_id': 'req-0416c128-da46-4e89-b236-fe1393c132bb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.665834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] The token cache is being invalidate because project e505f411abb9430fb6dc82bf7c802903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:30.666343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.668602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0416c128-da46-4e89-b236-fe1393c132bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:30.670553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1077/2141] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:30 2022] DELETE /identity/v3/projects/e505f411abb9430fb6dc82bf7c802903 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:30.676363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525be1c7-c6fb-4f81-bd60-af46987b2364 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:30.676788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525be1c7-c6fb-4f81-bd60-af46987b2364 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:30.677209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525be1c7-c6fb-4f81-bd60-af46987b2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:30.702272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-525be1c7-c6fb-4f81-bd60-af46987b2364 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:30.704659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-525be1c7-c6fb-4f81-bd60-af46987b2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:30.787182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1065/2142] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:30.795635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c12f4e-d52f-4bd0-a51c-58dff90797b0 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:30.795936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c12f4e-d52f-4bd0-a51c-58dff90797b0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:30.796221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c12f4e-d52f-4bd0-a51c-58dff90797b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:30.821649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-47c12f4e-d52f-4bd0-a51c-58dff90797b0 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:30.821760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-47c12f4e-d52f-4bd0-a51c-58dff90797b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:30.831564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1078/2143] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:30.835713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525be1c7-c6fb-4f81-bd60-af46987b2364 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:30.845783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525be1c7-c6fb-4f81-bd60-af46987b2364 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:30.858562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:30.859234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:30.859566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:30.860489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:30.861664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:30.861973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:30.863899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:30.877415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1066/2144] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:30.881391 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c12f4e-d52f-4bd0-a51c-58dff90797b0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:30.892965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c12f4e-d52f-4bd0-a51c-58dff90797b0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:30.899783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:30.900531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:30.900902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:30.901228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:30.901923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:30.903931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:30.980782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1079/2145] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:30 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:30.985518 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:30.996591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0011f0-c604-43a6-bcd8-54c10d67f655 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:31.060688 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:31.061462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:31.061752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:31.062471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:31.063079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:31.065187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:31.180302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1067/2146] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:30 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:31.184529 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:31.195805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53dbd7-6436-4e5a-b4dc-16fa945b4419 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:31.200655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:31.201676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:31.201963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:31.202256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:31.202968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:31.205869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:31.216424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1080/2147] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:31.220929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:31.230699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea82472-40fd-47ec-8ed8-45d018dfdcbd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:31.235801 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3ccd2-df27-4ed0-ac08-56889d4b631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:31.236496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ccd2-df27-4ed0-ac08-56889d4b631b admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:31.236767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ccd2-df27-4ed0-ac08-56889d4b631b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:31.237051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3ccd2-df27-4ed0-ac08-56889d4b631b admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:31.237787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ccd2-df27-4ed0-ac08-56889d4b631b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:31.239375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3ccd2-df27-4ed0-ac08-56889d4b631b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:31.249316 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1068/2148] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:31.254329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:31.264124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a973f-48e9-45d7-9065-69e1f545f839 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:31.270254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:31.271142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:31.271431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:31.271714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] PATH_INFO: `/v3/projects/e740c52ad64142398b541359c4b59da4/users/aa5997154dac436286980abb7f34185a/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:31.287269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e740c52ad64142398b541359c4b59da4, user_id=aa5997154dac436286980abb7f34185a, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:31.290015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:31.362451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1081/2149] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:31 2022] PUT /identity/v3/projects/e740c52ad64142398b541359c4b59da4/users/aa5997154dac436286980abb7f34185a/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:31.367665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:31.368038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:31.368325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:31.386976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:31.388216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:31.476489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1069/2150] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:31.486873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:31.488715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:31.560104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb048a7-115e-4329-8ddc-e6e06c5b7248 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:31.564370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea15b4-ad35-4d90-ae55-5e6cb8d3c6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:31.564923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea15b4-ad35-4d90-ae55-5e6cb8d3c6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:31.565387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea15b4-ad35-4d90-ae55-5e6cb8d3c6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:31.565680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea15b4-ad35-4d90-ae55-5e6cb8d3c6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:31.574967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea15b4-ad35-4d90-ae55-5e6cb8d3c6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:31.576701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea15b4-ad35-4d90-ae55-5e6cb8d3c6a3 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:31.589837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1082/2151] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:36.389757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:36.393263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:36.407557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24ee0c-1959-497f-94f6-563c8faf111b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:36.413104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:36.414298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:36.414298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:36.414558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] PATH_INFO: `/v3/users/f7d0310f4a4d42b38d0a1d50419bfaed` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:36.415931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d0310f4a4d42b38d0a1d50419bfaed)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:36.423246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:36.629815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d0310f4a4d42b38d0a1d50419bfaed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:36.630597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d0310f4a4d42b38d0a1d50419bfaed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:36.649608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d0310f4a4d42b38d0a1d50419bfaed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:36.650736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d0310f4a4d42b38d0a1d50419bfaed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:36.664333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d0310f4a4d42b38d0a1d50419bfaed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:36.888873 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1070/2152] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:36 2022] DELETE /identity/v3/users/f7d0310f4a4d42b38d0a1d50419bfaed => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:36.905409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675713-a17d-4f8c-8b7c-3f2e79c31bf6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:36.905409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675713-a17d-4f8c-8b7c-3f2e79c31bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:36.905409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675713-a17d-4f8c-8b7c-3f2e79c31bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:36.931109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-59675713-a17d-4f8c-8b7c-3f2e79c31bf6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:36.933689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-59675713-a17d-4f8c-8b7c-3f2e79c31bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:37.049049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1083/2153] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:37.061343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:37.064642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:37.092505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:37.092798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:37.093069 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:37.155729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] MFA Rules not processed for user `aa5997154dac436286980abb7f34185a`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:37.155729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:37.156018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ab970-ae02-4c85-b655-1d3d2cae174c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:37.156018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a355c6-7777-4eb4-a610-ccf7e8be177c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:37.156018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a355c6-7777-4eb4-a610-ccf7e8be177c service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:37.156018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a355c6-7777-4eb4-a610-ccf7e8be177c service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:37.156445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a355c6-7777-4eb4-a610-ccf7e8be177c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:37.165405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a355c6-7777-4eb4-a610-ccf7e8be177c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:37.167736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a355c6-7777-4eb4-a610-ccf7e8be177c service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:37.180595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1071/2154] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:37.278062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1084/2155] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:37.288163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:37.288455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:37.288737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:37.308480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] MFA Rules not processed for user `aa5997154dac436286980abb7f34185a`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:37.309839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:37.319139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1072/2156] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:37.332704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:37.338465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:37.427475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cfc4c-53a1-41b5-b07d-4daabdef9af0 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:37.435110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740197ac-f7c1-4a76-a5db-1780bfcab995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:37.436939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740197ac-f7c1-4a76-a5db-1780bfcab995 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:37.437465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740197ac-f7c1-4a76-a5db-1780bfcab995 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:37.438954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740197ac-f7c1-4a76-a5db-1780bfcab995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:37.450372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740197ac-f7c1-4a76-a5db-1780bfcab995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:37.452340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740197ac-f7c1-4a76-a5db-1780bfcab995 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:37.465040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1085/2157] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:37.679439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:37.681645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:37.700737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5d575-8f79-45a9-ad7a-422453e79d80 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:37.708455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:37.710694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:37.711558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:37.712057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] PATH_INFO: `/v3/users/ffc6ba9e14894550afc44ffd20397dad` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:37.713905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc6ba9e14894550afc44ffd20397dad)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:37.725927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:37.970320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc6ba9e14894550afc44ffd20397dad'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:37.971599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc6ba9e14894550afc44ffd20397dad'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:37.987161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc6ba9e14894550afc44ffd20397dad'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:37.987907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc6ba9e14894550afc44ffd20397dad'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:37.997191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc6ba9e14894550afc44ffd20397dad'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:38.073754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1073/2158] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:37 2022] DELETE /identity/v3/users/ffc6ba9e14894550afc44ffd20397dad => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:38.086978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:38.087738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:38.087964 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:38.122034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:38.124157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:38.186456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:38.189492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:38.233178 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1086/2159] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:38.235084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:38.238636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:38.306569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ca085-9a8e-4afe-bdf4-7bd52dcca424 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:38.312221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:38.322710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:38.322710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:38.322710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] PATH_INFO: `/v3/projects/7d869c0c8d454a638bd1406ed4301abb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:38.322710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d869c0c8d454a638bd1406ed4301abb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:38.322710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:38.336158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9578f0-6e43-47e7-8ab5-54dd747a9e25 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:38.341944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:38.343439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:38.343798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:38.344793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:38.357221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:38.358693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:38.370974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1087/2160] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:38.448105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d869c0c8d454a638bd1406ed4301abb', 'request_id': 'req-7a32a260-5b95-44c7-ac1f-4a542b404e92'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:38.516249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d869c0c8d454a638bd1406ed4301abb', 'request_id': 'req-7a32a260-5b95-44c7-ac1f-4a542b404e92'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:38.525221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d869c0c8d454a638bd1406ed4301abb', 'request_id': 'req-7a32a260-5b95-44c7-ac1f-4a542b404e92'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:38.542228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] The token cache is being invalidate because project 7d869c0c8d454a638bd1406ed4301abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:38.543092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:38.559383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7a32a260-5b95-44c7-ac1f-4a542b404e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:38.569343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1074/2161] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:38 2022] DELETE /identity/v3/projects/7d869c0c8d454a638bd1406ed4301abb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:38.569874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:38.581459 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3550d-2cb8-4b08-bef8-918c161cca89 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:38.719844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:38.719844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:38.719844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:38.719844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] PATH_INFO: `/v3/users/d254a1d3f1b14f1c819d1a669a217ebb` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:38.720235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d254a1d3f1b14f1c819d1a669a217ebb)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:38.738363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:39.024296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd254a1d3f1b14f1c819d1a669a217ebb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.027850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd254a1d3f1b14f1c819d1a669a217ebb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.058344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd254a1d3f1b14f1c819d1a669a217ebb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.059353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944c6ec-69bb-410d-84b4-7e712c3c928e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:39.061411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944c6ec-69bb-410d-84b4-7e712c3c928e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:39.061917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944c6ec-69bb-410d-84b4-7e712c3c928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:39.082749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd254a1d3f1b14f1c819d1a669a217ebb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.087842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd254a1d3f1b14f1c819d1a669a217ebb'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.138822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-3944c6ec-69bb-410d-84b4-7e712c3c928e None None] MFA Rules not processed for user `aa5997154dac436286980abb7f34185a`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:39.142847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3944c6ec-69bb-410d-84b4-7e712c3c928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:39.206959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1088/2162] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:38 2022] DELETE /identity/v3/users/d254a1d3f1b14f1c819d1a669a217ebb => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:39.207934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:39.217912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:39.269184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1075/2163] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:39.317406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3885e7f-1535-4468-8e4b-7053999580a4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:39.326741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:39.326741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:39.327699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:39.327699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] PATH_INFO: `/v3/projects/a553701564044efa8162e085d0d7a4d8` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:39.329123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a553701564044efa8162e085d0d7a4d8)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:39.331057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:39.479608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a553701564044efa8162e085d0d7a4d8', 'request_id': 'req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.544708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a553701564044efa8162e085d0d7a4d8', 'request_id': 'req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.555618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a553701564044efa8162e085d0d7a4d8', 'request_id': 'req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.571953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] The token cache is being invalidate because project a553701564044efa8162e085d0d7a4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:39.572346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.573246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-4c94ee5e-2bc1-481a-b495-39b4bad48e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.575238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1089/2164] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:39 2022] DELETE /identity/v3/projects/a553701564044efa8162e085d0d7a4d8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:39.580265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944c6ec-69bb-410d-84b4-7e712c3c928e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:39.592971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944c6ec-69bb-410d-84b4-7e712c3c928e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:39.669981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:39.669981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:39.670370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:39.670721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] PATH_INFO: `/v3/users/51256b72abc24da4bc5bbd780002c11c` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:39.672298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51256b72abc24da4bc5bbd780002c11c)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:39.674584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:39.904911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51256b72abc24da4bc5bbd780002c11c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.905665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51256b72abc24da4bc5bbd780002c11c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.950843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51256b72abc24da4bc5bbd780002c11c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.951765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51256b72abc24da4bc5bbd780002c11c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:39.970214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51256b72abc24da4bc5bbd780002c11c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:40.028285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661304b-e306-469e-84d8-8a1bf082c1f0 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.032149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661304b-e306-469e-84d8-8a1bf082c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.032149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661304b-e306-469e-84d8-8a1bf082c1f0 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.032149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1090/2165] 10.222.0.87 () {54 vars in 912 bytes} [Wed Feb 16 18:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:21:40.037446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.037736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.038044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.057704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] MFA Rules not processed for user `9b842d30b55c48bf8f375bdcc829bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:40.058943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:40.086337 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1076/2166] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:39 2022] DELETE /identity/v3/users/51256b72abc24da4bc5bbd780002c11c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:40.121002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1091/2167] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:40.131435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:40.133410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:40.142946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:40.144925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:40.168690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7743c-4560-49a0-ada5-9de7331c5352 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:40.234051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fdd28-614a-4147-9290-9e5d254c01f1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:40.240042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:40.241271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.244780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2abe77-9500-4d3f-a785-422fbe7a3b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:40.250537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2abe77-9500-4d3f-a785-422fbe7a3b97 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.250537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2abe77-9500-4d3f-a785-422fbe7a3b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.250537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2abe77-9500-4d3f-a785-422fbe7a3b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.251057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.251057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] PATH_INFO: `/v3/projects/0bba95d2c2ea48e8b53dda0eed856528` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.251057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bba95d2c2ea48e8b53dda0eed856528)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:40.256138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:40.259412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2abe77-9500-4d3f-a785-422fbe7a3b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:40.260917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2abe77-9500-4d3f-a785-422fbe7a3b97 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:40.278793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1092/2168] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:40.467549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bba95d2c2ea48e8b53dda0eed856528', 'request_id': 'req-3ecf33be-5333-4a14-8957-4c73428a8cce'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:40.561682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bba95d2c2ea48e8b53dda0eed856528', 'request_id': 'req-3ecf33be-5333-4a14-8957-4c73428a8cce'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:40.571902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bba95d2c2ea48e8b53dda0eed856528', 'request_id': 'req-3ecf33be-5333-4a14-8957-4c73428a8cce'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:40.583901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] The token cache is being invalidate because project 0bba95d2c2ea48e8b53dda0eed856528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:40.584185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:40.584866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:40.586690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1077/2169] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:40 2022] DELETE /identity/v3/projects/0bba95d2c2ea48e8b53dda0eed856528 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:40.594704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adcf0c-5eb7-4507-b9e9-99de5605e010 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.595003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adcf0c-5eb7-4507-b9e9-99de5605e010 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.595289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adcf0c-5eb7-4507-b9e9-99de5605e010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.613273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-51adcf0c-5eb7-4507-b9e9-99de5605e010 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:40.614494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-51adcf0c-5eb7-4507-b9e9-99de5605e010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:40.691616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:40.692777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:40.755008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1093/2170] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:40.760687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3276a-e5aa-40ab-bf9b-8782ad0e2d29 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.760982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3276a-e5aa-40ab-bf9b-8782ad0e2d29 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.761896 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3276a-e5aa-40ab-bf9b-8782ad0e2d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.789481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-05f3276a-e5aa-40ab-bf9b-8782ad0e2d29 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:40.790738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-05f3276a-e5aa-40ab-bf9b-8782ad0e2d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:40.817095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1094/2171] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:40.818274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3276a-e5aa-40ab-bf9b-8782ad0e2d29 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:40.838949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3276a-e5aa-40ab-bf9b-8782ad0e2d29 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:40.845204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:40.846167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.846341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.846619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.847358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:40.847667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:40.848862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf33be-5333-4a14-8957-4c73428a8cce admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:40.849522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:40.860764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:40.862031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.862321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.862603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] PATH_INFO: `/v3/projects/829c6373f2784613a8c82bf4b32363bb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.863892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] RBAC: Authorizing `identity:delete_project(project_id=829c6373f2784613a8c82bf4b32363bb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:40.865985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:40.875291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1095/2172] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:40.879425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:40.899905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995dc9c-bf02-4f5d-9736-09c6507b707f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:40.916127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:40.916838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:40.917165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:40.917449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:40.918195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:40.920216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.041133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829c6373f2784613a8c82bf4b32363bb', 'request_id': 'req-14138730-c874-409a-aa06-7b05b3cb584c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:41.055432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1096/2173] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:40 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:41.060038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.135217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c707fb-da63-401e-80e7-ad8e4cd3c42e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.140016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.141377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.141822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.142068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.142955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.146514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.148601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829c6373f2784613a8c82bf4b32363bb', 'request_id': 'req-14138730-c874-409a-aa06-7b05b3cb584c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:41.157009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829c6373f2784613a8c82bf4b32363bb', 'request_id': 'req-14138730-c874-409a-aa06-7b05b3cb584c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:41.170284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] The token cache is being invalidate because project 829c6373f2784613a8c82bf4b32363bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:41.170572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:41.171983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-14138730-c874-409a-aa06-7b05b3cb584c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:41.177385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1078/2174] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:40 2022] DELETE /identity/v3/projects/829c6373f2784613a8c82bf4b32363bb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:41.180888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34a61-e416-4cf7-bbbb-127fa8872149 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.181329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34a61-e416-4cf7-bbbb-127fa8872149 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.181614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34a61-e416-4cf7-bbbb-127fa8872149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.206240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7eb34a61-e416-4cf7-bbbb-127fa8872149 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:41.207802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7eb34a61-e416-4cf7-bbbb-127fa8872149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:41.219811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1079/2175] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:41.227578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b244-60f2-4485-b86b-c2b40d5c6f81 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.227945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b244-60f2-4485-b86b-c2b40d5c6f81 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.228244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b244-60f2-4485-b86b-c2b40d5c6f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.244332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1097/2176] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:41.248400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.249614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-caf2b244-60f2-4485-b86b-c2b40d5c6f81 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:41.250994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:41.251738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-caf2b244-60f2-4485-b86b-c2b40d5c6f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:41.260288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1080/2177] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:41.264538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274d6d2-bda6-4467-a3eb-d56bc724399a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.265407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b244-60f2-4485-b86b-c2b40d5c6f81 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.271509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.271509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.278598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.278598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.278598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.278598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.281343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b244-60f2-4485-b86b-c2b40d5c6f81 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.288588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.289557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.289953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.290341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.291326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:41.292976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.293564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.311683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1081/2178] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:41.313791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.314269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1098/2179] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:41.315294 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.326602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808b2f-c151-41f8-8a0e-41ac16a47495 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.334837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.335485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60662ffc-2070-4f27-a507-07844c73c287 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.335664 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.336484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.336484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.337260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.339355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.350860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.351549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.351836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.352195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.353431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.354693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.382262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1099/2180] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:41.386532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.398831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6655945-df34-4a72-a178-726f85c87754 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.404062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbb7f-d491-4af2-9b30-8313c842a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.404966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbb7f-d491-4af2-9b30-8313c842a880 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.405314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbb7f-d491-4af2-9b30-8313c842a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.405595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbb7f-d491-4af2-9b30-8313c842a880 admin admin] PATH_INFO: `/v3/projects/872c6ec447cc466393b463c465163894/users/0197c18dba31467d99ccf72607545b00/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.425531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbb7f-d491-4af2-9b30-8313c842a880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872c6ec447cc466393b463c465163894, user_id=0197c18dba31467d99ccf72607545b00, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.428992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbb7f-d491-4af2-9b30-8313c842a880 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.482998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1082/2181] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:41.488937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.511958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1100/2182] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:41 2022] PUT /identity/v3/projects/872c6ec447cc466393b463c465163894/users/0197c18dba31467d99ccf72607545b00/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:41.534583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c631a-b92e-4b12-ae89-2f7c0e34d61d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.534880 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c631a-b92e-4b12-ae89-2f7c0e34d61d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.535159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c631a-b92e-4b12-ae89-2f7c0e34d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.606554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d37c631a-b92e-4b12-ae89-2f7c0e34d61d None None] MFA Rules not processed for user `0197c18dba31467d99ccf72607545b00`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:41.606554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d37c631a-b92e-4b12-ae89-2f7c0e34d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:41.621305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3887-f0d9-4491-8553-5859ecbc14e2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.763407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1101/2183] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:41.769250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c631a-b92e-4b12-ae89-2f7c0e34d61d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.773308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.773308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.773308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.773308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.774441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.776809 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.790670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c631a-b92e-4b12-ae89-2f7c0e34d61d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:41.795827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:41.805864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:41.805864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:41.805864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:41.805864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:41.805864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:41.923792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1083/2184] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/users => generated 290 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:41.923994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1102/2185] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:41.927455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.929418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:41.944243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614dfb-4ef4-474a-bffc-cbe110710249 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.046700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c86df-5653-4c6a-98fb-1e9a694d4a6f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.055538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.056605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.056903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.057356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.057758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.058090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.058212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.058596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.059331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.059485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.061371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.061736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.075419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1084/2186] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:42.081968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.094916 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96aaa7-5623-45d1-924b-5604d4fa1985 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.100200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.101318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.101621 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.101905 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.102712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.104418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.115995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1085/2187] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:42.120342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.136383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e0c9b-21f3-41fc-92d1-ad995d316cfb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.144555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ab5ef-5e0d-4113-9c88-d7bb7c1e941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.145504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab5ef-5e0d-4113-9c88-d7bb7c1e941d admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.145792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab5ef-5e0d-4113-9c88-d7bb7c1e941d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.149501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ab5ef-5e0d-4113-9c88-d7bb7c1e941d admin admin] PATH_INFO: `/v3/projects/d66eb53fcd7a48abb4150843758bf964/users/1867304850674c56a1d4d66ca84c5984/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.150073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1103/2188] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:41 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:42.153662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.164773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab5ef-5e0d-4113-9c88-d7bb7c1e941d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66eb53fcd7a48abb4150843758bf964, user_id=1867304850674c56a1d4d66ca84c5984, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.165601 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d7477-7d3e-441c-a646-c80b3d82c20a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.168135 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ab5ef-5e0d-4113-9c88-d7bb7c1e941d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.172460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.173187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.173481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.173757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.174685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.176432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.187978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1104/2189] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:42.192778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.204988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7f7c-65b6-4ed6-947a-a8906e7a5ac6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.209987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.210879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.211162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.211435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] PATH_INFO: `/v3/projects/80b182ba231c4234abd4efcdf6d1ac5c/users/1501affe67b4478f8f3c7366bc686251/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.228891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b182ba231c4234abd4efcdf6d1ac5c, user_id=1501affe67b4478f8f3c7366bc686251, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.231651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.243151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1086/2190] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:42 2022] PUT /identity/v3/projects/d66eb53fcd7a48abb4150843758bf964/users/1867304850674c56a1d4d66ca84c5984/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:42.256581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5683eb-2fdc-403b-b746-416dfcf6a456 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.257005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5683eb-2fdc-403b-b746-416dfcf6a456 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.257333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5683eb-2fdc-403b-b746-416dfcf6a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.289189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5f5683eb-2fdc-403b-b746-416dfcf6a456 None None] MFA Rules not processed for user `1867304850674c56a1d4d66ca84c5984`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:42.290319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5f5683eb-2fdc-403b-b746-416dfcf6a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:42.304796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1105/2191] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:42 2022] PUT /identity/v3/projects/80b182ba231c4234abd4efcdf6d1ac5c/users/1501affe67b4478f8f3c7366bc686251/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:42.309345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.362149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1087/2192] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:42.370025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5683eb-2fdc-403b-b746-416dfcf6a456 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.400101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb0feb-a620-466c-9907-eb7a28618662 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.405151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.405877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.406989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.407277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.408006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.409678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.420293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1106/2193] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:42.424688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.436422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f133c-3117-4709-aafb-12791608adb6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.441877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d215d-1fc2-4b6e-a6fe-956f9aa7be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.442778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d215d-1fc2-4b6e-a6fe-956f9aa7be8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.443059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d215d-1fc2-4b6e-a6fe-956f9aa7be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.443332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d215d-1fc2-4b6e-a6fe-956f9aa7be8e admin admin] PATH_INFO: `/v3/projects/80b182ba231c4234abd4efcdf6d1ac5c/users/1501affe67b4478f8f3c7366bc686251/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.444015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5683eb-2fdc-403b-b746-416dfcf6a456 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.445470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d215d-1fc2-4b6e-a6fe-956f9aa7be8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b182ba231c4234abd4efcdf6d1ac5c, user_id=1501affe67b4478f8f3c7366bc686251, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.448118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d215d-1fc2-4b6e-a6fe-956f9aa7be8e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.448881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.449588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.449880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.450161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.452337 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.455140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.461053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1107/2194] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:42 2022] PUT /identity/v3/projects/80b182ba231c4234abd4efcdf6d1ac5c/users/1501affe67b4478f8f3c7366bc686251/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:42.471436 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.471730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.472007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.525689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] MFA Rules not processed for user `1501affe67b4478f8f3c7366bc686251`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:42.526970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:42.554493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1088/2195] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:42 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:42.556548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.649300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1108/2196] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:42.651136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.652596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:42.656026 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945483a-e2b4-40f8-b0ae-95143f59531c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.662507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.663611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.664071 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.664641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.665836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.667834 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.718129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887ca73-e015-4fc9-bdb0-0a7f6490c441 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.745467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1089/2197] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:42 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:42.752638 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.769888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa6db3-fe31-4cb7-bb96-8a7619dd90d5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.776226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.777190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.777467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.777746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.778552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.780184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.792575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1090/2198] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:42.796543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.799648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.800618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.801000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.804839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.808760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9513281-457d-4ca3-9ee1-45834155e65d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.814417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.815078 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.815362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.815642 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.816400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.818031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.830625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1091/2199] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:42.834657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.844740 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07f6b3-98ef-4412-9b07-06733ffbae65 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:42.850372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcefb1-a60c-409a-b38c-636d4ac111df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:42.851471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcefb1-a60c-409a-b38c-636d4ac111df admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:42.851765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcefb1-a60c-409a-b38c-636d4ac111df admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:42.852025 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcefb1-a60c-409a-b38c-636d4ac111df admin admin] PATH_INFO: `/v3/projects/81d18efe4220406a85b91952ce2b5681/users/47dde8fa43e9466a91113fb004e77950/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:42.871430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcefb1-a60c-409a-b38c-636d4ac111df admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d18efe4220406a85b91952ce2b5681, user_id=47dde8fa43e9466a91113fb004e77950, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.873233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:42.874736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.876270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcefb1-a60c-409a-b38c-636d4ac111df admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:42.888361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1109/2200] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:42.992549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1092/2201] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:42 2022] PUT /identity/v3/projects/81d18efe4220406a85b91952ce2b5681/users/47dde8fa43e9466a91113fb004e77950/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:42.996689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:42.998229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:43.005188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ecbc-1532-487f-b56a-7516185be543 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.005543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ecbc-1532-487f-b56a-7516185be543 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.005862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ecbc-1532-487f-b56a-7516185be543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.010460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d87740-5d32-4764-8663-e2a86ab9b46d service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.042896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c4b0ecbc-1532-487f-b56a-7516185be543 None None] MFA Rules not processed for user `47dde8fa43e9466a91113fb004e77950`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:43.044118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c4b0ecbc-1532-487f-b56a-7516185be543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:43.076177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.077115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.082679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.082679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.133467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1093/2202] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:43.138309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ecbc-1532-487f-b56a-7516185be543 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:43.153637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.154520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.166309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1110/2203] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:43.210376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ecbc-1532-487f-b56a-7516185be543 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.215695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.216422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.217371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.217371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.221828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.221828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.311757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1094/2204] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:43 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:21:43.316174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:43.327285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940e3ce-d302-4916-82fa-303aba204563 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.381060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.381749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.382027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.382296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.382980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.384889 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.492926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1111/2205] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:43 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:43.496870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:43.507426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266113a9-0112-4454-bbe9-462978db2827 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.512099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.512752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.513167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.513450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.514207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.515775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.526640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1095/2206] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:43.530786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:43.542654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a3909-0b59-46fe-b699-ced35d40eacb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.548097 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.549019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.549342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.549676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] PATH_INFO: `/v3/projects/3717fe5993dc44a9b4ade41ff4991e44/users/014f5a4631bf4558b85b0b54eaafa402/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.564836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3717fe5993dc44a9b4ade41ff4991e44, user_id=014f5a4631bf4558b85b0b54eaafa402, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.567539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.635585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1112/2207] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:43 2022] PUT /identity/v3/projects/3717fe5993dc44a9b4ade41ff4991e44/users/014f5a4631bf4558b85b0b54eaafa402/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:43.639705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:43.651012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec737e-40a9-44dc-8512-cbc7dff33581 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.711703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73513e-734f-4145-94ce-3f37e8092cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.712465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73513e-734f-4145-94ce-3f37e8092cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.713151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73513e-734f-4145-94ce-3f37e8092cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.713151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73513e-734f-4145-94ce-3f37e8092cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.713934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73513e-734f-4145-94ce-3f37e8092cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.715513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73513e-734f-4145-94ce-3f37e8092cd2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.726551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1096/2208] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:43.730675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:43.745303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d44c-1910-44db-8e0c-e50e619070de admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.750389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.753250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.753250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.753250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] PATH_INFO: `/v3/projects/3717fe5993dc44a9b4ade41ff4991e44/users/014f5a4631bf4558b85b0b54eaafa402/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.753819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3717fe5993dc44a9b4ade41ff4991e44, user_id=014f5a4631bf4558b85b0b54eaafa402, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.756432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.767504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1113/2209] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:43 2022] PUT /identity/v3/projects/3717fe5993dc44a9b4ade41ff4991e44/users/014f5a4631bf4558b85b0b54eaafa402/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:43.781774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef918aa6-d207-4c08-942a-38afb03164b2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.781774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef918aa6-d207-4c08-942a-38afb03164b2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.781774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef918aa6-d207-4c08-942a-38afb03164b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.809312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ef918aa6-d207-4c08-942a-38afb03164b2 None None] MFA Rules not processed for user `014f5a4631bf4558b85b0b54eaafa402`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:43.810675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ef918aa6-d207-4c08-942a-38afb03164b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:43.887635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1097/2210] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:43.898602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:43.963549 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56a712-0ad3-487d-9221-84d311ff2b2d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:43.971245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:43.971245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.971245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.971245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.982047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:43.983623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:43.992906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72fd33-5fe1-4d7a-85a6-7952769b94e4 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:43.993308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72fd33-5fe1-4d7a-85a6-7952769b94e4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:43.993655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72fd33-5fe1-4d7a-85a6-7952769b94e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:43.993818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1114/2211] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:44.014288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6b72fd33-5fe1-4d7a-85a6-7952769b94e4 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:44.016460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6b72fd33-5fe1-4d7a-85a6-7952769b94e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:44.072359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1098/2212] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:44.122604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:44.124578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:44.130917 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72fd33-5fe1-4d7a-85a6-7952769b94e4 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:44.147924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72fd33-5fe1-4d7a-85a6-7952769b94e4 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:44.154176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb308b-3e3a-4fb5-bf1f-8c5f6a6700fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:44.155227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb308b-3e3a-4fb5-bf1f-8c5f6a6700fa service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:44.155704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb308b-3e3a-4fb5-bf1f-8c5f6a6700fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:44.156345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb308b-3e3a-4fb5-bf1f-8c5f6a6700fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:44.225286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb66a05-fd07-4d9d-8138-d4342dcbf051 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:44.230674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:44.231431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:44.231796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:44.232167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:44.233121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb308b-3e3a-4fb5-bf1f-8c5f6a6700fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:44.235142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb308b-3e3a-4fb5-bf1f-8c5f6a6700fa service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:44.241848 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:44.243551 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:44.244871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1099/2213] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:44.253397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1115/2214] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:21:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:21:45.117649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9765ea-adfb-4e3e-9386-dca6d65c699c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:45.117940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9765ea-adfb-4e3e-9386-dca6d65c699c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:45.118224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9765ea-adfb-4e3e-9386-dca6d65c699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:45.136124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5f9765ea-adfb-4e3e-9386-dca6d65c699c None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:45.137358 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5f9765ea-adfb-4e3e-9386-dca6d65c699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:45.144720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1100/2215] 10.222.0.87 () {58 vars in 967 bytes} [Wed Feb 16 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:45.158818 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:45.169982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1fbf9-f0e4-49e3-9c8f-f6cb0b6e17e9 service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:45.175839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:45.176534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:45.176793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:45.177088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:45.185193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:45.186843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:45.195566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1116/2216] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:21:45.812759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81b41-ded8-4c9a-8e56-b6182393f61c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:45.813382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81b41-ded8-4c9a-8e56-b6182393f61c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:45.813382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81b41-ded8-4c9a-8e56-b6182393f61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:45.831911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0bf81b41-ded8-4c9a-8e56-b6182393f61c None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:45.833113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0bf81b41-ded8-4c9a-8e56-b6182393f61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:45.840674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1101/2217] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:45.853132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:45.863402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5fb75-d7f5-4c04-bb5f-953716d8c06b service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:45.868361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:45.868992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:45.869618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:45.869618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:45.877742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:45.879310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:45.887136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1117/2218] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:21:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:21:46.618746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:46.619038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:46.619315 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:46.642623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:46.644209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:46.651629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1102/2219] 10.222.0.87 () {58 vars in 967 bytes} [Wed Feb 16 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:46.665354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:46.676316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8fdb3-886a-48c6-92d9-944e2817c5ad service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:46.682437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:46.683157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:46.683517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:46.684646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:46.693579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:46.695244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:46.704196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1118/2220] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:21:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:21:49.862577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:49.864247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:49.994591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5f4e-d2f1-498f-a020-3ced0717d415 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:50.000991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:50.002468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.002914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.003359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] PATH_INFO: `/v3/users/2437e97b666e423989f44ac92bc18600` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.005757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2437e97b666e423989f44ac92bc18600)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:50.008197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:50.166003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:50.167411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.181605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a882bce-fbda-4c3f-9348-a61e387da949 service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:50.187078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:50.189640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.189640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.189640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] PATH_INFO: `/v3/users/c8277578891e409e93a1d01c086f3be0` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.190808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8277578891e409e93a1d01c086f3be0)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:50.194039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:50.271901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2437e97b666e423989f44ac92bc18600'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.272549 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2437e97b666e423989f44ac92bc18600'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.284164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2437e97b666e423989f44ac92bc18600'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.284789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2437e97b666e423989f44ac92bc18600'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.291933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2437e97b666e423989f44ac92bc18600'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.390121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1103/2221] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:49 2022] DELETE /identity/v3/users/2437e97b666e423989f44ac92bc18600 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:50.391133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:50.392452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.433375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8277578891e409e93a1d01c086f3be0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.434132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8277578891e409e93a1d01c086f3be0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.441737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8277578891e409e93a1d01c086f3be0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.453905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8277578891e409e93a1d01c086f3be0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.454703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a1620e9d-9334-480f-b6fa-b2b82853aaa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8277578891e409e93a1d01c086f3be0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.457852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa3beb-3429-4795-b54c-ab995732ebb6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:50.462360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:50.463246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.463507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.463781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] PATH_INFO: `/v3/users/0197c18dba31467d99ccf72607545b00` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.464987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0197c18dba31467d99ccf72607545b00)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:50.466924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:50.527082 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1119/2222] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:50 2022] DELETE /identity/v3/users/c8277578891e409e93a1d01c086f3be0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:50.528386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397990e7-ce23-4574-9937-b71df8f2f9cb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.528682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397990e7-ce23-4574-9937-b71df8f2f9cb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.528968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397990e7-ce23-4574-9937-b71df8f2f9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.545817 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-397990e7-ce23-4574-9937-b71df8f2f9cb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:50.547507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-397990e7-ce23-4574-9937-b71df8f2f9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.606933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1120/2223] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:50.608589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.609009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.609918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.632360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:50.634277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.646895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1121/2224] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:50.648057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:50.651316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.681431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0197c18dba31467d99ccf72607545b00'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.682216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0197c18dba31467d99ccf72607545b00'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.698188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0197c18dba31467d99ccf72607545b00'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.698925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0197c18dba31467d99ccf72607545b00'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.708230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f12ee2d2-78f1-470f-8ece-f8f0fa1a5d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0197c18dba31467d99ccf72607545b00'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:50.727935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dddb50-1588-4e67-8a9e-e4c04d025fbd None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:50.731814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:50.732463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.732755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.733029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.736167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.748310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:50.749833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:50.760338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1122/2225] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:50.761259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:50.762680 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.774742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8139db4-d307-4683-b489-46008a84a346 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:50.788973 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:50.789120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1104/2226] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:50 2022] DELETE /identity/v3/users/0197c18dba31467d99ccf72607545b00 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:50.789217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.789217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.789217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.789217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.789502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.789502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.789502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.798938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:50.801105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:50.806038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:50.807332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.811816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1123/2227] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:50.869228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1105/2228] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:50.877307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:50.879024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:50.892299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e0a6-1fca-4a97-be3f-6944cd45fa2f service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:50.973539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:50.974203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:50.974969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:50.975393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:50.990716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:50.992854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:51.004829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1124/2229] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:51.098972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:51.100419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:51.115090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856691f-bd14-4938-8cef-bf38c369dfef None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:51.120004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:51.120898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:51.121224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:51.121507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] PATH_INFO: `/v3/users/1867304850674c56a1d4d66ca84c5984` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:51.122743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1867304850674c56a1d4d66ca84c5984)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:51.124761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:51.141123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:51.142951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:51.158613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ee960-102f-403e-af56-a1c84b649446 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:51.177623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:51.180462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:51.180931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:51.181544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] PATH_INFO: `/v3/projects/b3f56ad3a05943d093d380cc13a24017` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:51.183917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f56ad3a05943d093d380cc13a24017)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:51.186906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:51.412711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1867304850674c56a1d4d66ca84c5984'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.413862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1867304850674c56a1d4d66ca84c5984'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.422160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f56ad3a05943d093d380cc13a24017', 'request_id': 'req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.444571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1867304850674c56a1d4d66ca84c5984'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.445960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1867304850674c56a1d4d66ca84c5984'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.461018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1867304850674c56a1d4d66ca84c5984'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.543331 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f56ad3a05943d093d380cc13a24017', 'request_id': 'req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.551966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f56ad3a05943d093d380cc13a24017', 'request_id': 'req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.570088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] The token cache is being invalidate because project b3f56ad3a05943d093d380cc13a24017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:51.570949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.571849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.575180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1125/2230] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:51 2022] DELETE /identity/v3/projects/b3f56ad3a05943d093d380cc13a24017 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:51.576142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:51.579626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:51.649839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1106/2231] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:51 2022] DELETE /identity/v3/users/1867304850674c56a1d4d66ca84c5984 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:51.655367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:51.657654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:51.679812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33dfbc-da0e-45f2-889c-e4b3cdefa914 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:51.744263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6df37-35f8-4caa-9cba-cd07c47a9b79 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:51.751235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:51.752137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:51.752426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:51.752710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] PATH_INFO: `/v3/projects/872c6ec447cc466393b463c465163894` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:51.754206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=872c6ec447cc466393b463c465163894)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:51.756126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:51.774446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:51.775704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:51.775976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:51.776550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] PATH_INFO: `/v3/users/cfdc5197e8c94f0786d0f63fd8c3fdac` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:51.777870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdc5197e8c94f0786d0f63fd8c3fdac)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:51.780092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:51.965364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872c6ec447cc466393b463c465163894', 'request_id': 'req-dd7068ae-aae8-4d85-af34-5115f09963fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.965929 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdc5197e8c94f0786d0f63fd8c3fdac'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.966636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdc5197e8c94f0786d0f63fd8c3fdac'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.975646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdc5197e8c94f0786d0f63fd8c3fdac'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.987489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdc5197e8c94f0786d0f63fd8c3fdac'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:51.988284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdc5197e8c94f0786d0f63fd8c3fdac'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.029550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872c6ec447cc466393b463c465163894', 'request_id': 'req-dd7068ae-aae8-4d85-af34-5115f09963fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.036823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872c6ec447cc466393b463c465163894', 'request_id': 'req-dd7068ae-aae8-4d85-af34-5115f09963fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.048174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] The token cache is being invalidate because project 872c6ec447cc466393b463c465163894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:52.048471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.049171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-dd7068ae-aae8-4d85-af34-5115f09963fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.050983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1107/2232] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:51 2022] DELETE /identity/v3/projects/872c6ec447cc466393b463c465163894 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:52.053755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:52.053755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:52.053755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:52.070761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:52.072000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.115541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1126/2233] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:51 2022] DELETE /identity/v3/users/cfdc5197e8c94f0786d0f63fd8c3fdac => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:52.116647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:52.118033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.131602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1108/2234] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:52.133945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:52.135399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.147975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85fec2-b6df-4f3c-b9ed-f12845450358 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:52.186763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c6db5-49cf-4f2e-8b02-b7caa797c397 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:52.192558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:52.193683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:52.194127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:52.194570 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] PATH_INFO: `/v3/projects/7396358abac542beaf777cb411512aa8` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:52.196039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7396358abac542beaf777cb411512aa8)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:52.198507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:52.208054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:52.209614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:52.209614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:52.209614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] PATH_INFO: `/v3/users/1501affe67b4478f8f3c7366bc686251` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:52.210883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1501affe67b4478f8f3c7366bc686251)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:52.213059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:52.310882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7396358abac542beaf777cb411512aa8', 'request_id': 'req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.393496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1501affe67b4478f8f3c7366bc686251'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.394401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1501affe67b4478f8f3c7366bc686251'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.395719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7396358abac542beaf777cb411512aa8', 'request_id': 'req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.403092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7396358abac542beaf777cb411512aa8', 'request_id': 'req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.413558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1501affe67b4478f8f3c7366bc686251'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.414557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1501affe67b4478f8f3c7366bc686251'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.416930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] The token cache is being invalidate because project 7396358abac542beaf777cb411512aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:52.417271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.417986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-084fa2c3-95f3-4f68-8ab2-45bb3aeb90a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.419678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1127/2235] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:52 2022] DELETE /identity/v3/projects/7396358abac542beaf777cb411512aa8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:52.425542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:52.425889 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:52.426021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1501affe67b4478f8f3c7366bc686251'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.426205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:52.447380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:52.448586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.512600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1128/2236] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:52.513491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:52.514860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.518375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1109/2237] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:52 2022] DELETE /identity/v3/users/1501affe67b4478f8f3c7366bc686251 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:52.522602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:52.525779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.591034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc0721-ebee-44c9-9049-bccbd374b766 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:52.610532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e299-a585-4ce5-a036-2694edfe3ae9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:52.616894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:52.618439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:52.618897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:52.619850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] PATH_INFO: `/v3/users/dcb6e5e7f9664df29903ff290ddaa1fb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:52.621561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb6e5e7f9664df29903ff290ddaa1fb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:52.624577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:52.655212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:52.655981 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:52.657416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:52.657827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:52.659653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.676079 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:52.677603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:52.693281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1129/2238] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:52.695298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:52.697949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:52.711496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f10b0-9df0-457d-95a5-f1e8b5b3a24d service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:52.716021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:52.716842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:52.717297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:52.717582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:52.731952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:52.733586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:52.746525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1130/2239] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:52.829660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb6e5e7f9664df29903ff290ddaa1fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.830415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb6e5e7f9664df29903ff290ddaa1fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.845539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb6e5e7f9664df29903ff290ddaa1fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.846432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb6e5e7f9664df29903ff290ddaa1fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.854462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb6e5e7f9664df29903ff290ddaa1fb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:52.933439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1110/2240] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:52 2022] DELETE /identity/v3/users/dcb6e5e7f9664df29903ff290ddaa1fb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:53.043407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:53.045683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:53.060079 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f376655-f34d-4ce7-9314-ebc81b78bc6a service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:53.139515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:53.140437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.141342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.141673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] PATH_INFO: `/v3/projects/80b182ba231c4234abd4efcdf6d1ac5c` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.142953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b182ba231c4234abd4efcdf6d1ac5c)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:53.146982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:53.219639 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:53.221365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:53.244313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1de11b-9c8a-4ae0-8348-9e1c8cf79861 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:53.251200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b182ba231c4234abd4efcdf6d1ac5c', 'request_id': 'req-d544a416-9d55-4128-9e04-bed4c2448d22'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.313039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:53.318181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.318181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.318181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] PATH_INFO: `/v3/projects/65b8359d2c5e4c549f22c684215e2af2` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.318181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b8359d2c5e4c549f22c684215e2af2)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:53.318181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:53.337872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b182ba231c4234abd4efcdf6d1ac5c', 'request_id': 'req-d544a416-9d55-4128-9e04-bed4c2448d22'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.344913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b182ba231c4234abd4efcdf6d1ac5c', 'request_id': 'req-d544a416-9d55-4128-9e04-bed4c2448d22'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.356016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] The token cache is being invalidate because project 80b182ba231c4234abd4efcdf6d1ac5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:53.356311 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.356962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.358550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1131/2241] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:53 2022] DELETE /identity/v3/projects/80b182ba231c4234abd4efcdf6d1ac5c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:53.361266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:53.361428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:53.376440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544a416-9d55-4128-9e04-bed4c2448d22 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:53.381925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:53.382917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.383202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.383480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] PATH_INFO: `/v3/projects/d66eb53fcd7a48abb4150843758bf964` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.384914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66eb53fcd7a48abb4150843758bf964)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:53.386913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:53.430136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b8359d2c5e4c549f22c684215e2af2', 'request_id': 'req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.504176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b8359d2c5e4c549f22c684215e2af2', 'request_id': 'req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.514522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b8359d2c5e4c549f22c684215e2af2', 'request_id': 'req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.528707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66eb53fcd7a48abb4150843758bf964', 'request_id': 'req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.534480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] The token cache is being invalidate because project 65b8359d2c5e4c549f22c684215e2af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:53.535165 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.536146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6fa4d3bf-a73f-4a8e-bdff-0ea7601ebc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.538585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1111/2242] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:53 2022] DELETE /identity/v3/projects/65b8359d2c5e4c549f22c684215e2af2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:53.543899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385cbb-3849-4050-92f9-78111d134c39 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.544425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385cbb-3849-4050-92f9-78111d134c39 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.549172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385cbb-3849-4050-92f9-78111d134c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.564910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b4385cbb-3849-4050-92f9-78111d134c39 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:53.566174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b4385cbb-3849-4050-92f9-78111d134c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:53.595472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66eb53fcd7a48abb4150843758bf964', 'request_id': 'req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.601711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66eb53fcd7a48abb4150843758bf964', 'request_id': 'req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.614030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] The token cache is being invalidate because project d66eb53fcd7a48abb4150843758bf964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:53.614338 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.614991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.616540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1132/2243] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:53 2022] DELETE /identity/v3/projects/d66eb53fcd7a48abb4150843758bf964 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:53.619527 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:53.619527 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:53.628710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1112/2244] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:53.630205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.630508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.630790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.649350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:53.650573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:53.659878 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1113/2245] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:53.660487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:53.661764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:53.674478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d9cdd-d97b-4c47-9f98-8277a9be0b8c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:53.679608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:53.680487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.680776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.681059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] PATH_INFO: `/v3/users/47dde8fa43e9466a91113fb004e77950` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.682346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47dde8fa43e9466a91113fb004e77950)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:53.684258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:53.688841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b221c5-a3e5-4d12-91f7-0db5f23532f2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:53.694241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:53.695129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.695413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.695697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] PATH_INFO: `/v3/projects/b2915bcd9b1042a3b9a389f0efd1d6e3` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.696886 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2915bcd9b1042a3b9a389f0efd1d6e3)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:53.698899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:53.875108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dde8fa43e9466a91113fb004e77950'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.875926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2915bcd9b1042a3b9a389f0efd1d6e3', 'request_id': 'req-9fe83d38-b520-4e71-8964-e1b5a499c63f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.876148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dde8fa43e9466a91113fb004e77950'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.888596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dde8fa43e9466a91113fb004e77950'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.889361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dde8fa43e9466a91113fb004e77950'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.896780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8b822bb8-9531-474d-bb5e-0c82d1624e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dde8fa43e9466a91113fb004e77950'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.938569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2915bcd9b1042a3b9a389f0efd1d6e3', 'request_id': 'req-9fe83d38-b520-4e71-8964-e1b5a499c63f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.945609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2915bcd9b1042a3b9a389f0efd1d6e3', 'request_id': 'req-9fe83d38-b520-4e71-8964-e1b5a499c63f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.958163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] The token cache is being invalidate because project b2915bcd9b1042a3b9a389f0efd1d6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:53.958877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.959155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9fe83d38-b520-4e71-8964-e1b5a499c63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:53.964965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1133/2246] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:53 2022] DELETE /identity/v3/projects/b2915bcd9b1042a3b9a389f0efd1d6e3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:53.964965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939891-a503-418e-bdec-1e14d199246f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:53.964965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939891-a503-418e-bdec-1e14d199246f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:53.964965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939891-a503-418e-bdec-1e14d199246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:53.984925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-8a939891-a503-418e-bdec-1e14d199246f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:53.986430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8a939891-a503-418e-bdec-1e14d199246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.030429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1114/2247] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:53 2022] DELETE /identity/v3/users/47dde8fa43e9466a91113fb004e77950 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:54.035830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c727-8f1b-4bd7-87b3-9373b08f8bc8 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.036184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c727-8f1b-4bd7-87b3-9373b08f8bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.036793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c727-8f1b-4bd7-87b3-9373b08f8bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.056673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-aa67c727-8f1b-4bd7-87b3-9373b08f8bc8 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:54.058036 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-aa67c727-8f1b-4bd7-87b3-9373b08f8bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.073225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1134/2248] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:54.073430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2879df6-dcb2-45cc-a0b2-92280ebd2013 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.073633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2879df6-dcb2-45cc-a0b2-92280ebd2013 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.074620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2879df6-dcb2-45cc-a0b2-92280ebd2013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.102095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a2879df6-dcb2-45cc-a0b2-92280ebd2013 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:54.103216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a2879df6-dcb2-45cc-a0b2-92280ebd2013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.136077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1115/2249] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:54.136935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67c727-8f1b-4bd7-87b3-9373b08f8bc8 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.148920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67c727-8f1b-4bd7-87b3-9373b08f8bc8 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.153729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.154389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.158143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.158143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.158143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:54.158143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.158415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.169763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1116/2250] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:54.170777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.177140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1135/2251] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:54.178098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2879df6-dcb2-45cc-a0b2-92280ebd2013 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.180207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a2c8c-a412-4464-a51f-23943e5822ed admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.185007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8d19f-e9e1-4e65-b6cf-9529a43d4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.185691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d19f-e9e1-4e65-b6cf-9529a43d4bca admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.185976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d19f-e9e1-4e65-b6cf-9529a43d4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.186253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8d19f-e9e1-4e65-b6cf-9529a43d4bca admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.186970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8d19f-e9e1-4e65-b6cf-9529a43d4bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:54.187342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8d19f-e9e1-4e65-b6cf-9529a43d4bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.189035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8d19f-e9e1-4e65-b6cf-9529a43d4bca admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.190129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2879df6-dcb2-45cc-a0b2-92280ebd2013 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.195856 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.196519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.200535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.200535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.200535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.200535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.203265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1117/2252] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:54.204662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6330ed-4e3a-4656-819b-0e937412c56b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.204995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6330ed-4e3a-4656-819b-0e937412c56b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.205345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6330ed-4e3a-4656-819b-0e937412c56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.223763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0c6330ed-4e3a-4656-819b-0e937412c56b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:54.224953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0c6330ed-4e3a-4656-819b-0e937412c56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.233027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1118/2253] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:54.233857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6330ed-4e3a-4656-819b-0e937412c56b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.243402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6330ed-4e3a-4656-819b-0e937412c56b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.248442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.249120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.249607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.250058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.250755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.252641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.326224 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1136/2254] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/projects => generated 407 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:54.328537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.392130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc8362-def9-481e-9c98-35b6d94b39f3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.397306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.398028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.398319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.398714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.399452 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:54.399764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.400570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1119/2255] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:54.401838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.402157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.415506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1137/2256] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:54.416645 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.426126 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e95fab-1a8c-49a7-98e4-e3e4a5fc9a79 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.469732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7bcd7-3183-41d0-ba75-ba8d8d033e03 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.474678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.475352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.475632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.475908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.476598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.478552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.487008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.487008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.487008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.487008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.487348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.488133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.561721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1120/2257] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/users => generated 304 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:54.563362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.572980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10573592-6801-4595-8a07-040798bd5ca1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.578684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.579422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.579710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.579987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.580667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.582662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.590676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1138/2258] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:54.591377 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.592983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.604933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c70dd-c8fb-44ad-9708-e9d17a997734 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.609813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.610663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.611070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.611226 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] PATH_INFO: `/v3/projects/81d18efe4220406a85b91952ce2b5681` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.614193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d18efe4220406a85b91952ce2b5681)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.614431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.665766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1121/2259] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:54.672381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.716212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d18efe4220406a85b91952ce2b5681', 'request_id': 'req-1ffa59ff-0249-4662-9d66-1314821baede'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:54.733198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7d69c-8fb3-48f0-982e-958160193122 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.784068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d18efe4220406a85b91952ce2b5681', 'request_id': 'req-1ffa59ff-0249-4662-9d66-1314821baede'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:54.787693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.788369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.788655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.788934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.791594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.792479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d18efe4220406a85b91952ce2b5681', 'request_id': 'req-1ffa59ff-0249-4662-9d66-1314821baede'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:54.792601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.802409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] The token cache is being invalidate because project 81d18efe4220406a85b91952ce2b5681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:54.802706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1122/2260] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:54.802875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:54.803468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:54.803579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.805371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1139/2261] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:54 2022] DELETE /identity/v3/projects/81d18efe4220406a85b91952ce2b5681 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:54.805483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.806153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.807587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.818243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9968c63-ac89-4f05-adf7-507d8309e000 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.820881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa59ff-0249-4662-9d66-1314821baede admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.822780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.823432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.823785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.824122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.824778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.825637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.826288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.826657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.826825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.827100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.827871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.829904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.836671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1123/2262] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:54.837483 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.839295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.851858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f063-43b5-4615-b0ea-6c1c59e24ef7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.856377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.857306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.857591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.857868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] PATH_INFO: `/v3/users/014f5a4631bf4558b85b0b54eaafa402` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.859563 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014f5a4631bf4558b85b0b54eaafa402)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.861470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.915976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1140/2263] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:54 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:54.916733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.918288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:54.930313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3ec6-ac82-4f43-ba56-d599e5d6d94a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.935267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.935987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.936302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.936568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.937464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.939203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.949282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1141/2264] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:54.950208 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.960681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a617595-05e2-4d79-ae7b-87df459a5b3a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.965544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.966172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.966456 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.969072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.969072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.969901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:54.980036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1142/2265] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:54.980794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:54.989715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d328d-df7c-405e-b42a-0559dfe2b140 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:54.994314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:54.994931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:54.995215 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:54.995492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:54.996199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:54.997793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.002786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014f5a4631bf4558b85b0b54eaafa402'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:55.003657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014f5a4631bf4558b85b0b54eaafa402'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:55.007489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1143/2266] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:55.008253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.010631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.016882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014f5a4631bf4558b85b0b54eaafa402'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:55.017609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014f5a4631bf4558b85b0b54eaafa402'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:55.024730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca3b3-e8de-47d3-bbfa-ce051a63ac20 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.026669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014f5a4631bf4558b85b0b54eaafa402'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:55.030893 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.031862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.032232 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.032527 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] PATH_INFO: `/v3/projects/5e90fa04f6174b33815cdc7d5fbb8876/users/545d7575984449b2a1df2c5787cd49e1/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.047347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e90fa04f6174b33815cdc7d5fbb8876, user_id=545d7575984449b2a1df2c5787cd49e1, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.050047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.074216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1124/2267] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:54 2022] DELETE /identity/v3/users/014f5a4631bf4558b85b0b54eaafa402 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:55.075117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.076707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.150691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf313b3-03f1-442d-a8e1-068f805ee236 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.151211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1144/2268] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:55 2022] PUT /identity/v3/projects/5e90fa04f6174b33815cdc7d5fbb8876/users/545d7575984449b2a1df2c5787cd49e1/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:55.161511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.163866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.222697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.223720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.224007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.224564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] PATH_INFO: `/v3/projects/91e373f8f02f4244b6092ccaa53dc1eb/users/b2c1f951cc2543aa8aa658af9568636b/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.242341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e373f8f02f4244b6092ccaa53dc1eb, user_id=b2c1f951cc2543aa8aa658af9568636b, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.245539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.246941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a38e79-cd1e-4b2d-854a-a294a432d814 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.252773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a543f-07d8-42a4-9b4f-c7f818ddf708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.253626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a543f-07d8-42a4-9b4f-c7f818ddf708 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.253903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a543f-07d8-42a4-9b4f-c7f818ddf708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.254183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a543f-07d8-42a4-9b4f-c7f818ddf708 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.254908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a543f-07d8-42a4-9b4f-c7f818ddf708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.256507 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a543f-07d8-42a4-9b4f-c7f818ddf708 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.267205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1145/2269] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:55.268494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2450c-b251-482f-9115-4653a0db37e7 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.268778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2450c-b251-482f-9115-4653a0db37e7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.269055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2450c-b251-482f-9115-4653a0db37e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.296888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d8f2450c-b251-482f-9115-4653a0db37e7 None None] MFA Rules not processed for user `545d7575984449b2a1df2c5787cd49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:55.296888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d8f2450c-b251-482f-9115-4653a0db37e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.341368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1125/2270] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:55 2022] PUT /identity/v3/projects/91e373f8f02f4244b6092ccaa53dc1eb/users/b2c1f951cc2543aa8aa658af9568636b/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:55.353175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.370253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1146/2271] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:55.371566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d00b9-f3af-4da4-9404-72bc9e9ba997 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.373204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d00b9-f3af-4da4-9404-72bc9e9ba997 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.373204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d00b9-f3af-4da4-9404-72bc9e9ba997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.402607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-200d00b9-f3af-4da4-9404-72bc9e9ba997 None None] MFA Rules not processed for user `b2c1f951cc2543aa8aa658af9568636b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:55.404048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-200d00b9-f3af-4da4-9404-72bc9e9ba997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.433577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e1bcb-684e-465b-bf9a-9678ab539b93 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.440286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.441220 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.441502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.441774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] PATH_INFO: `/v3/projects/0c7408771bfd4c21b77f0325ee8c8af9/users/6bc8b7ca8c984379b852e9c680196f9b/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.459477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7408771bfd4c21b77f0325ee8c8af9, user_id=6bc8b7ca8c984379b852e9c680196f9b, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.462243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.473620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1147/2272] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:55.474519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d00b9-f3af-4da4-9404-72bc9e9ba997 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.490200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d00b9-f3af-4da4-9404-72bc9e9ba997 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.494596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf85717-f910-4dd2-acc4-c8414f58b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.495403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf85717-f910-4dd2-acc4-c8414f58b03e admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.495693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf85717-f910-4dd2-acc4-c8414f58b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.495968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf85717-f910-4dd2-acc4-c8414f58b03e admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.496672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf85717-f910-4dd2-acc4-c8414f58b03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.498646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf85717-f910-4dd2-acc4-c8414f58b03e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.521704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1126/2273] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:55 2022] PUT /identity/v3/projects/0c7408771bfd4c21b77f0325ee8c8af9/users/6bc8b7ca8c984379b852e9c680196f9b/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:55.522544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.524104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.590091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1148/2274] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:55 2022] POST /identity/v3/projects => generated 407 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:55.590091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.590091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.590091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.595945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832355b7-0c9b-4d47-b0fe-f496a588caf7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.628838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] MFA Rules not processed for user `6bc8b7ca8c984379b852e9c680196f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:55.630102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.662693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.663114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.663401 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.663693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.709460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1149/2275] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:55.713753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.715033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:55.733512 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.736009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.746788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1127/2276] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:55.747681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.788399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e09a7-c892-429d-aa3c-eb8948996b6e None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.794072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.795140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.795780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.796278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] PATH_INFO: `/v3/projects/3717fe5993dc44a9b4ade41ff4991e44` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.798651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3717fe5993dc44a9b4ade41ff4991e44)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.800800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.820513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab357-8baf-4788-a5b8-298a6c2c746e service glance] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.825737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.826701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.826990 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.827274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.828847 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.830879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.898163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3717fe5993dc44a9b4ade41ff4991e44', 'request_id': 'req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:55.913942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1128/2277] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:55 2022] POST /identity/v3/users => generated 310 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:55.913942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:55.923894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9068b900-b879-41b9-9a9b-b1904e2adc98 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:55.981393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb0f12-4de9-4b02-a272-a39674460cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:55.982066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb0f12-4de9-4b02-a272-a39674460cdf admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:55.982352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb0f12-4de9-4b02-a272-a39674460cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:55.982635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb0f12-4de9-4b02-a272-a39674460cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:55.983614 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb0f12-4de9-4b02-a272-a39674460cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:55.984235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3717fe5993dc44a9b4ade41ff4991e44', 'request_id': 'req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:55.985733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb0f12-4de9-4b02-a272-a39674460cdf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:55.990264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3717fe5993dc44a9b4ade41ff4991e44', 'request_id': 'req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:56.002186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] The token cache is being invalidate because project 3717fe5993dc44a9b4ade41ff4991e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:56.002474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:56.003139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:56.004692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1150/2278] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:55 2022] DELETE /identity/v3/projects/3717fe5993dc44a9b4ade41ff4991e44 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:56.005555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.007031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:56.020134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3a705-1d7d-44d3-b59d-b22ae68fc9d9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.024895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b7811-62d0-4611-8924-3d9816e7f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.025672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7811-62d0-4611-8924-3d9816e7f83a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.025958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7811-62d0-4611-8924-3d9816e7f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.026233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7811-62d0-4611-8924-3d9816e7f83a admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.026949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b7811-62d0-4611-8924-3d9816e7f83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.028604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b7811-62d0-4611-8924-3d9816e7f83a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.038664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1151/2279] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:56.039932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e9bf-34fb-46f2-b029-98fe426730c7 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.040223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e9bf-34fb-46f2-b029-98fe426730c7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.040501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e9bf-34fb-46f2-b029-98fe426730c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.058210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c420e9bf-34fb-46f2-b029-98fe426730c7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:56.059393 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c420e9bf-34fb-46f2-b029-98fe426730c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:56.068015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1152/2280] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:56.068809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e9bf-34fb-46f2-b029-98fe426730c7 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.081286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e9bf-34fb-46f2-b029-98fe426730c7 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.083709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1129/2281] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:55 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:56.085061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.085566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.089333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.110194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:56.111685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:56.147261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.148222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.154320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.154320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] PATH_INFO: `/v3/projects/a513d688f12948e6a72697e17324bfb4/users/545d1d5c6a31443facd0184cf982a9be/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.164380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a513d688f12948e6a72697e17324bfb4, user_id=545d1d5c6a31443facd0184cf982a9be, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.167162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.177147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1130/2282] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:56.177439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.179028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:56.191622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05d50a-f991-4ed7-868d-97bab9e81769 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.196500 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.197188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.197509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.197704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.198442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.200277 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.242493 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1153/2283] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:56 2022] PUT /identity/v3/projects/a513d688f12948e6a72697e17324bfb4/users/545d1d5c6a31443facd0184cf982a9be/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:56.243495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.304278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af346967-e407-4ecc-8106-6d5adf19084d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.309292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.309956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.310239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.310516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.311233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:21:56.311945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.313159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.327340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1154/2284] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:21:56.328803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.336588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1131/2285] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:56 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:56.338247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.341590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00a7f4-0594-4251-880f-a8b0d8ffb9a5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.347793 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.348609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.348959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.349343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.350261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.352087 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.354690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6cb3-702d-4a43-ad18-554da8a6f28e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.360950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396dbeb-8dcc-4f6e-8771-90915ad09e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.361674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396dbeb-8dcc-4f6e-8771-90915ad09e74 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.362089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396dbeb-8dcc-4f6e-8771-90915ad09e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.362369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396dbeb-8dcc-4f6e-8771-90915ad09e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.366602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1155/2286] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:56.366743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396dbeb-8dcc-4f6e-8771-90915ad09e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.366822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.366915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396dbeb-8dcc-4f6e-8771-90915ad09e74 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.380489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867df8-22d6-4116-b815-cb850c00ccdd admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.385315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.386400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.386695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.386979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.387999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.389461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.401554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1156/2287] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:56.402363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.414432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00475b26-36c5-45a0-807b-ec454a06c733 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.419331 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.420920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.421496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.421690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] PATH_INFO: `/v3/projects/a513d688f12948e6a72697e17324bfb4/users/545d1d5c6a31443facd0184cf982a9be/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.424055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a513d688f12948e6a72697e17324bfb4, user_id=545d1d5c6a31443facd0184cf982a9be, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.426773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.444225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1157/2288] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:56 2022] PUT /identity/v3/projects/a513d688f12948e6a72697e17324bfb4/users/545d1d5c6a31443facd0184cf982a9be/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:56.445115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.455791 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1132/2289] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:56 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:56.457982 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c2a0-e106-41bb-8a84-ddd2fe0b88c3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.458627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c2a0-e106-41bb-8a84-ddd2fe0b88c3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.458627 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553c2a0-e106-41bb-8a84-ddd2fe0b88c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.495053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e553c2a0-e106-41bb-8a84-ddd2fe0b88c3 None None] MFA Rules not processed for user `545d1d5c6a31443facd0184cf982a9be`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:56.496657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e553c2a0-e106-41bb-8a84-ddd2fe0b88c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:56.544323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28f488-714f-46e8-8baa-1ee579c6e2f8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.591175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1133/2290] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:56.592035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553c2a0-e106-41bb-8a84-ddd2fe0b88c3 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.615661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.617029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.617467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.617808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] PATH_INFO: `/v3/projects/a05d95cde1c142ad8c8ebea563769d81/users/6d1f12f1063f49939dd4d3f8db49ab57/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.635250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05d95cde1c142ad8c8ebea563769d81, user_id=6d1f12f1063f49939dd4d3f8db49ab57, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.637971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.662454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553c2a0-e106-41bb-8a84-ddd2fe0b88c3 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.667208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.667889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.668176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.668454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.669258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.671175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.726915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1158/2291] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:56 2022] PUT /identity/v3/projects/a05d95cde1c142ad8c8ebea563769d81/users/6d1f12f1063f49939dd4d3f8db49ab57/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:56.727742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.729290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:56.761883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1134/2292] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:56 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:56.761883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.767771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ca46-d39e-4128-9bd5-93972ab4fc58 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.791292 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c99662-86fb-4829-8d4b-2d52369d32a1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.795085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.795727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.796011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.796404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.825468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.826593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.826894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.827236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.828203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.829844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.842856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1135/2293] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:56.842856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.853364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852697d2-c695-43ad-b4d0-c3122854796f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.858391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.859910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.860404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.860495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.861207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.862784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.864865 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.866333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.872879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1136/2294] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:56.873699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.879435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1159/2295] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:56.883260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468282bc-cdd8-405e-ad8e-46d0e305b49d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.884424 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.888667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb327f-c15d-458e-8d39-37bf161be72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.889597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb327f-c15d-458e-8d39-37bf161be72d admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.889896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb327f-c15d-458e-8d39-37bf161be72d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.890264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb327f-c15d-458e-8d39-37bf161be72d admin admin] PATH_INFO: `/v3/projects/a05d95cde1c142ad8c8ebea563769d81/users/6d1f12f1063f49939dd4d3f8db49ab57/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.892961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb327f-c15d-458e-8d39-37bf161be72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05d95cde1c142ad8c8ebea563769d81, user_id=6d1f12f1063f49939dd4d3f8db49ab57, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.895674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb327f-c15d-458e-8d39-37bf161be72d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.896374 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daa28d-dd63-48bb-abef-0542369ad904 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.901314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:56.901976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.902260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.902540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.903263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:56.904911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:56.909021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1137/2296] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:56 2022] PUT /identity/v3/projects/a05d95cde1c142ad8c8ebea563769d81/users/6d1f12f1063f49939dd4d3f8db49ab57/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:56.921055 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806c4f-0186-49c4-b632-704a5c3d5f1b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:56.922068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806c4f-0186-49c4-b632-704a5c3d5f1b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:56.922322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d806c4f-0186-49c4-b632-704a5c3d5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:56.928153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1160/2297] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:21:56.932475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:56.943062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec2fd9-68d4-4164-b273-72a393180f6f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:56.950749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4d806c4f-0186-49c4-b632-704a5c3d5f1b None None] MFA Rules not processed for user `6d1f12f1063f49939dd4d3f8db49ab57`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:56.952222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4d806c4f-0186-49c4-b632-704a5c3d5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:57.003017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8b4f2-0f9d-42e0-87b4-8c2d3bb826f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:57.003911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8b4f2-0f9d-42e0-87b4-8c2d3bb826f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.004191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8b4f2-0f9d-42e0-87b4-8c2d3bb826f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.004467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8b4f2-0f9d-42e0-87b4-8c2d3bb826f3 admin admin] PATH_INFO: `/v3/projects/f60c54ba2bbe446aa22ba5693fe711ed/users/acdd3d31c274478181957438c9c6a90f/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.023034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8b4f2-0f9d-42e0-87b4-8c2d3bb826f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60c54ba2bbe446aa22ba5693fe711ed, user_id=acdd3d31c274478181957438c9c6a90f, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:57.023034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8b4f2-0f9d-42e0-87b4-8c2d3bb826f3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:57.024713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1138/2298] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:57.035273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d806c4f-0186-49c4-b632-704a5c3d5f1b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:57.091227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d806c4f-0186-49c4-b632-704a5c3d5f1b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:57.095659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:57.096157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.096444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.096767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.106075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:57.107920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1161/2299] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:56 2022] PUT /identity/v3/projects/f60c54ba2bbe446aa22ba5693fe711ed/users/acdd3d31c274478181957438c9c6a90f/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:57.108034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:57.117517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1139/2300] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:21:57.118687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcacd3-60fc-4a00-abac-80037696c2e6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.118989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcacd3-60fc-4a00-abac-80037696c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.119267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcacd3-60fc-4a00-abac-80037696c2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.149585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-41fcacd3-60fc-4a00-abac-80037696c2e6 None None] MFA Rules not processed for user `acdd3d31c274478181957438c9c6a90f`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:57.151722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-41fcacd3-60fc-4a00-abac-80037696c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:57.241705 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1162/2301] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:57.246414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:57.266204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54c794-a893-4974-aa13-e0059b697614 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:57.276727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcacd3-60fc-4a00-abac-80037696c2e6 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:57.359814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:57.360450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcacd3-60fc-4a00-abac-80037696c2e6 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:57.360617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.360903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.361215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.361906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:57.363939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:57.365248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:57.366219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.366671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.367096 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] PATH_INFO: `/v3/users/6bc8b7ca8c984379b852e9c680196f9b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.368597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc8b7ca8c984379b852e9c680196f9b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:57.370702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:57.463788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1140/2302] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:21:57 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:57.463788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:57.548175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdf4b-4973-4ae1-9331-2d7a4cec04bb admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:57.552462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:57.553003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.553322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.553598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.558449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:57.639346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc8b7ca8c984379b852e9c680196f9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:57.640372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc8b7ca8c984379b852e9c680196f9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:57.649269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc8b7ca8c984379b852e9c680196f9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:57.651230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:57.652742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:57.663522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc8b7ca8c984379b852e9c680196f9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:57.664245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2043b645-efc0-4032-9842-3069c7f92198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc8b7ca8c984379b852e9c680196f9b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:57.667235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1141/2303] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:57.670057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:57.743545 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1163/2304] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:57 2022] DELETE /identity/v3/users/6bc8b7ca8c984379b852e9c680196f9b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:21:57.749196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.749517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.749850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.782868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7962171-1e90-4a6c-bdc0-2b32cd05bb95 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:57.794005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:57.798160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:57.889577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1164/2305] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:57.898704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:57.899969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:57.900087 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.900360 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.900967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.901952 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:57.902779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:57.914406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:57.975200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0249ba-ffce-4d31-8bc9-048de6b1f20e None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:57.979053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:57.979700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:57.979988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:57.980266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:57.989708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:57.991139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:58.000847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1165/2306] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:58.002099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1142/2307] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:21:57 2022] POST /identity/v3/users => generated 297 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:21:58.005971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:58.007297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:58.022223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90c1f-44c8-4325-b938-5a8783954186 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:58.027905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:58.028630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.028942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.029224 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.030007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:58.032316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:58.043897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1166/2308] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:58.048857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:58.061141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4e2c1-547a-453b-b386-8f90316f6b6b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:58.066207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:58.067378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.067665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.068897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] PATH_INFO: `/v3/projects/b0954eaf8dc742e4a2cff0f5815c2a44/users/384a967c789d4777bb08bba59d43713d/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.086566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0954eaf8dc742e4a2cff0f5815c2a44, user_id=384a967c789d4777bb08bba59d43713d, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:58.091424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:58.150817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1143/2309] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:58 2022] PUT /identity/v3/projects/b0954eaf8dc742e4a2cff0f5815c2a44/users/384a967c789d4777bb08bba59d43713d/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:58.155031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:58.166092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6489ed-c71a-4365-a54f-40c62dd422c5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:58.231741 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc73d2-f56a-452f-8648-cd34a3b57820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:58.232416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc73d2-f56a-452f-8648-cd34a3b57820 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.232699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc73d2-f56a-452f-8648-cd34a3b57820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.232976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc73d2-f56a-452f-8648-cd34a3b57820 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.233770 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc73d2-f56a-452f-8648-cd34a3b57820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:58.235720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc73d2-f56a-452f-8648-cd34a3b57820 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:58.246007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1167/2310] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:21:58.251023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:58.261302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda83744-ab99-4e1b-9173-b98d7a249ba6 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:58.266812 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:58.267707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.267991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.274872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] PATH_INFO: `/v3/projects/b0954eaf8dc742e4a2cff0f5815c2a44/users/384a967c789d4777bb08bba59d43713d/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.274872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0954eaf8dc742e4a2cff0f5815c2a44, user_id=384a967c789d4777bb08bba59d43713d, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:58.274872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:58.285050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1144/2311] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:21:58 2022] PUT /identity/v3/projects/b0954eaf8dc742e4a2cff0f5815c2a44/users/384a967c789d4777bb08bba59d43713d/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:58.297041 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.297505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.297886 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.333943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] MFA Rules not processed for user `384a967c789d4777bb08bba59d43713d`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:58.335190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:58.406511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1168/2312] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:21:58.416101 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:58.417940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:58.461429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:58.464405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:58.479784 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db456-c8d6-44f9-a263-117ec029c866 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:58.485929 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:58.486707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.487330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.487450 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.500015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:58.500501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:58.510455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1145/2313] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:58.532011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda353ca-eefe-4426-98d8-edc9c933ad39 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:58.539764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:58.539764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.539764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.539764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] PATH_INFO: `/v3/projects/0c7408771bfd4c21b77f0325ee8c8af9` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.542195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7408771bfd4c21b77f0325ee8c8af9)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:58.544255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:58.725361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7408771bfd4c21b77f0325ee8c8af9', 'request_id': 'req-9d4722b1-425e-4102-b51c-3cb3fd2f7868'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:58.795530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7408771bfd4c21b77f0325ee8c8af9', 'request_id': 'req-9d4722b1-425e-4102-b51c-3cb3fd2f7868'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:58.802777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7408771bfd4c21b77f0325ee8c8af9', 'request_id': 'req-9d4722b1-425e-4102-b51c-3cb3fd2f7868'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:58.820284 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] The token cache is being invalidate because project 0c7408771bfd4c21b77f0325ee8c8af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:21:58.820581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:58.821317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:58.823075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1169/2314] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:58 2022] DELETE /identity/v3/projects/0c7408771bfd4c21b77f0325ee8c8af9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:58.827245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:58.838341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf49e-f7cd-4261-9701-bafeb1102417 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:58.914615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:58.915073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:58.915309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:58.915590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] PATH_INFO: `/v3/users/6d1f12f1063f49939dd4d3f8db49ab57` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:58.917601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1f12f1063f49939dd4d3f8db49ab57)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:58.919532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:59.077603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:59.079133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:59.091526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4722b1-425e-4102-b51c-3cb3fd2f7868 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:59.096685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:59.097590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:59.097874 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:59.098150 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] PATH_INFO: `/v3/users/acdd3d31c274478181957438c9c6a90f` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:59.099342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdd3d31c274478181957438c9c6a90f)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:59.101314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:59.123843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1f12f1063f49939dd4d3f8db49ab57'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.125173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1f12f1063f49939dd4d3f8db49ab57'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.137061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1f12f1063f49939dd4d3f8db49ab57'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.138010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1f12f1063f49939dd4d3f8db49ab57'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.145602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-6903e4c9-2671-44d9-86d7-905f83b0cd90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1f12f1063f49939dd4d3f8db49ab57'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.257900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1146/2315] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:58 2022] DELETE /identity/v3/users/6d1f12f1063f49939dd4d3f8db49ab57 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:59.301755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdd3d31c274478181957438c9c6a90f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.304545 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdd3d31c274478181957438c9c6a90f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.311959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdd3d31c274478181957438c9c6a90f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.323947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdd3d31c274478181957438c9c6a90f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.324658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdd3d31c274478181957438c9c6a90f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.419240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1170/2316] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:21:59 2022] DELETE /identity/v3/users/acdd3d31c274478181957438c9c6a90f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:21:59.424059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:59.424565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:59.424738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:59.442606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:21:59.443988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:59.514730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1147/2317] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:21:59.521497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:59.523561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:59.592697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81db9c3-9401-4275-8c06-e27b06b16a40 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:59.597350 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a92ecb-8484-44fe-9a1e-c76433de5584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:59.598075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92ecb-8484-44fe-9a1e-c76433de5584 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:59.598431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92ecb-8484-44fe-9a1e-c76433de5584 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:59.598782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92ecb-8484-44fe-9a1e-c76433de5584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:59.610533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a92ecb-8484-44fe-9a1e-c76433de5584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:59.612019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a92ecb-8484-44fe-9a1e-c76433de5584 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:59.621968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1171/2318] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:21:59.678728 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:21:59.680224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:21:59.706034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160470-07e3-446f-81bf-c8d00b29bdc6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:21:59.717870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:21:59.719253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:21:59.719695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:21:59.720060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] PATH_INFO: `/v3/projects/a05d95cde1c142ad8c8ebea563769d81` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:21:59.722352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05d95cde1c142ad8c8ebea563769d81)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:21:59.726023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:21:59.892945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05d95cde1c142ad8c8ebea563769d81', 'request_id': 'req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.978597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05d95cde1c142ad8c8ebea563769d81', 'request_id': 'req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:21:59.989837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05d95cde1c142ad8c8ebea563769d81', 'request_id': 'req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.006214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] The token cache is being invalidate because project a05d95cde1c142ad8c8ebea563769d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:00.006623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.007377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7b6ab64e-9cf6-4820-87a7-3d5cae8743e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.009258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1148/2319] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:21:59 2022] DELETE /identity/v3/projects/a05d95cde1c142ad8c8ebea563769d81 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:00.014043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.014542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.014754 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.034734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:00.035922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:00.113105 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1172/2320] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:00.131404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270fd9b-c330-44c0-8d73-89cf165d5376 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.131701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270fd9b-c330-44c0-8d73-89cf165d5376 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.131987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270fd9b-c330-44c0-8d73-89cf165d5376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.151462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.153263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:00.154526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8270fd9b-c330-44c0-8d73-89cf165d5376 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:00.156426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8270fd9b-c330-44c0-8d73-89cf165d5376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:00.165445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1149/2321] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:00.169872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270fd9b-c330-44c0-8d73-89cf165d5376 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.170309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7b32a-5233-47f5-9f4c-00b263d8d0a2 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.179106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.180242 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.180546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.187902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] PATH_INFO: `/v3/projects/f60c54ba2bbe446aa22ba5693fe711ed` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.188037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270fd9b-c330-44c0-8d73-89cf165d5376 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.188153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60c54ba2bbe446aa22ba5693fe711ed)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.188153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.188601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.189985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.190376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.190768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.191779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:00.192208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.194103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.224234 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1150/2322] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:22:00.225795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.240922 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce258-924f-4694-8061-0f14e030d798 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.251683 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.252578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.252928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.253321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.254094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.256089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.305591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60c54ba2bbe446aa22ba5693fe711ed', 'request_id': 'req-f3d39c9a-6a74-48c4-a7af-268497a12298'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.383798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60c54ba2bbe446aa22ba5693fe711ed', 'request_id': 'req-f3d39c9a-6a74-48c4-a7af-268497a12298'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.389884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60c54ba2bbe446aa22ba5693fe711ed', 'request_id': 'req-f3d39c9a-6a74-48c4-a7af-268497a12298'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.390738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1151/2323] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:00 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:00.395190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.401784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] The token cache is being invalidate because project f60c54ba2bbe446aa22ba5693fe711ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:00.402074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.402746 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.404340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1173/2324] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:00 2022] DELETE /identity/v3/projects/f60c54ba2bbe446aa22ba5693fe711ed => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:00.409426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.410926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:00.473613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188660-f1f5-4503-805b-a5f4a0b4127a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.479031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.479876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.480230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.480603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.481779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.483640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.502008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d39c9a-6a74-48c4-a7af-268497a12298 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.506930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.507802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.508115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.508428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] PATH_INFO: `/v3/users/384a967c789d4777bb08bba59d43713d` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.509664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384a967c789d4777bb08bba59d43713d)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.511624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.555820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1152/2325] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:00 2022] POST /identity/v3/users => generated 282 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:00.559960 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.561695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:00.574139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96525a5f-024f-45ad-ae64-676459fb6aaa admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.580020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.580665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.580944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.581249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.581962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.583658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.593505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1153/2326] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:00.597663 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.608027 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989860b-2167-4cab-9c60-5d8331251c27 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.613217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.614127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.614421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.618213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.618213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.618213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.629044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1154/2327] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:00.633299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.646480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fe2b5-5195-43c7-bdd3-b13e761f6fd9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.651236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f286-8fc2-411c-8239-44b5c9318dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.652122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f286-8fc2-411c-8239-44b5c9318dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.652415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f286-8fc2-411c-8239-44b5c9318dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.652697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f286-8fc2-411c-8239-44b5c9318dc0 admin admin] PATH_INFO: `/v3/projects/f986b3604f504873a996ea8d00ec0f14/users/59a42933bf6b45a2b8d8ab7a1e608691/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.668753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f286-8fc2-411c-8239-44b5c9318dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f986b3604f504873a996ea8d00ec0f14, user_id=59a42933bf6b45a2b8d8ab7a1e608691, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.671573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f286-8fc2-411c-8239-44b5c9318dc0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:00.684537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384a967c789d4777bb08bba59d43713d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.685425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384a967c789d4777bb08bba59d43713d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.693112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384a967c789d4777bb08bba59d43713d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.716274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384a967c789d4777bb08bba59d43713d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.716274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384a967c789d4777bb08bba59d43713d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:00.733689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1155/2328] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:00 2022] PUT /identity/v3/projects/f986b3604f504873a996ea8d00ec0f14/users/59a42933bf6b45a2b8d8ab7a1e608691/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:00.747362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f297c-344f-4bb4-9989-415137c04d7c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.747852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f297c-344f-4bb4-9989-415137c04d7c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.750240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f297c-344f-4bb4-9989-415137c04d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.773395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1174/2329] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:00 2022] DELETE /identity/v3/users/384a967c789d4777bb08bba59d43713d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:00.779705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b12f297c-344f-4bb4-9989-415137c04d7c None None] MFA Rules not processed for user `59a42933bf6b45a2b8d8ab7a1e608691`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:00.781606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b12f297c-344f-4bb4-9989-415137c04d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:00.852166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1156/2330] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:00.856450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:00.857904 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:00.932173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875230e1-cfe3-4f95-b276-d5236b242b40 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:00.937025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:00.937708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:00.937992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:00.938269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:00.938980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:00.941297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.023571 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1175/2331] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:00 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:01.028736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f297c-344f-4bb4-9989-415137c04d7c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.041488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f297c-344f-4bb4-9989-415137c04d7c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.132188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.134519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.135018 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.135516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.136883 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.141003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.238633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.239201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:01.253297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f827a6f-87ba-44c4-afa2-e10921eec859 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.258005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.259004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.259506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.259618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] PATH_INFO: `/v3/projects/b0954eaf8dc742e4a2cff0f5815c2a44` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.260735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0954eaf8dc742e4a2cff0f5815c2a44)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.265809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.269424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1157/2332] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:01 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:01.270543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.282217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72976b8-5186-4a39-849e-0b13cb4dfea8 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.287061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.287841 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.288470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.288601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.289691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.291619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.303409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1158/2333] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:01.307681 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.319846 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d75ef-686d-47fe-99c9-3f55017de072 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.323461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.324344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.324631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.325096 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] PATH_INFO: `/v3/projects/2b4da38aeace4c12be620377eda599f4/users/25ec7706a04b4527b63b491627588cea/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.341559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4da38aeace4c12be620377eda599f4, user_id=25ec7706a04b4527b63b491627588cea, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.344572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.527998 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1159/2334] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:01 2022] PUT /identity/v3/projects/2b4da38aeace4c12be620377eda599f4/users/25ec7706a04b4527b63b491627588cea/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:01.532428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.544140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0954eaf8dc742e4a2cff0f5815c2a44', 'request_id': 'req-54f39c25-c47e-4a04-8645-040cf0a72919'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:01.596780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751dc7-8840-44f8-ab5e-719524108464 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.624181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0954eaf8dc742e4a2cff0f5815c2a44', 'request_id': 'req-54f39c25-c47e-4a04-8645-040cf0a72919'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:01.631317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0954eaf8dc742e4a2cff0f5815c2a44', 'request_id': 'req-54f39c25-c47e-4a04-8645-040cf0a72919'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:01.643143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] The token cache is being invalidate because project b0954eaf8dc742e4a2cff0f5815c2a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:01.643437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:01.644093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-54f39c25-c47e-4a04-8645-040cf0a72919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:01.645758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1176/2335] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:01 2022] DELETE /identity/v3/projects/b0954eaf8dc742e4a2cff0f5815c2a44 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:01.650603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe46ba1-c02d-437c-9a2a-9388a6fa724b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.650930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe46ba1-c02d-437c-9a2a-9388a6fa724b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.651219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe46ba1-c02d-437c-9a2a-9388a6fa724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.654554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.656987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.656987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.656987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.656987 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.658291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.668418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1160/2336] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:01.669055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-efe46ba1-c02d-437c-9a2a-9388a6fa724b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:01.670446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-efe46ba1-c02d-437c-9a2a-9388a6fa724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:01.673378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.675106 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:01.679406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1177/2337] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:01.690242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f984c94-0800-4e2e-b17f-3e6a88757307 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.690474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8bc4-83b0-4bc8-8bca-61a4d2213514 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.690771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8bc4-83b0-4bc8-8bca-61a4d2213514 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.691098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c8bc4-83b0-4bc8-8bca-61a4d2213514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.695297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ff141-cc4d-40ea-b023-1a719b10aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.696236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff141-cc4d-40ea-b023-1a719b10aa32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.696572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff141-cc4d-40ea-b023-1a719b10aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.696849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ff141-cc4d-40ea-b023-1a719b10aa32 admin admin] PATH_INFO: `/v3/projects/2b4da38aeace4c12be620377eda599f4/users/25ec7706a04b4527b63b491627588cea/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.699731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff141-cc4d-40ea-b023-1a719b10aa32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4da38aeace4c12be620377eda599f4, user_id=25ec7706a04b4527b63b491627588cea, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.702992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ff141-cc4d-40ea-b023-1a719b10aa32 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.709598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a53c8bc4-83b0-4bc8-8bca-61a4d2213514 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:01.725213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a53c8bc4-83b0-4bc8-8bca-61a4d2213514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:01.725376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1161/2338] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:01 2022] PUT /identity/v3/projects/2b4da38aeace4c12be620377eda599f4/users/25ec7706a04b4527b63b491627588cea/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:01.729964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.730311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.730588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.758723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] MFA Rules not processed for user `25ec7706a04b4527b63b491627588cea`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:01.759937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:01.770776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1178/2339] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:01.775084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8bc4-83b0-4bc8-8bca-61a4d2213514 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.783920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c8bc4-83b0-4bc8-8bca-61a4d2213514 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.788685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.789362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.789651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.789926 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.790640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:01.790946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.792540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.806499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1179/2340] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:22:01.810598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.821214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806e70-87aa-45ac-b1da-91d2e8d3cb5a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.826839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.827526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.827813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.828201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.828889 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.830966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.835601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1162/2341] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:01.845633 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.847006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:01.904107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475aa01-3ed3-4d80-8f85-33e2377a7236 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.907854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1180/2342] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:01 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:01.908716 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.909457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.909741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.910016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.911897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:01.920254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.922402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:01.933125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1163/2343] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:01.981235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e264b-3854-492a-9f07-bd86e58629ec admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:01.986443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:01.987113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:01.987486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:01.987771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:01.988463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:01.990556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.065310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1181/2344] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:01 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:02.070259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.081183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44373c-86ff-4e30-b8e1-1c65d519c394 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.085913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.086571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.086854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.087130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.087867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.089490 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.099995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1164/2345] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:02.104075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.114647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc344f06-9cca-4b2f-9c15-03e65cc07fcb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.119297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.119949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.120231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.120509 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.124805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.124805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.133249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1182/2346] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:02.137432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.147706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99c4d5-b33d-48eb-9bd1-cf1698fdaf66 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.153764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203067f-86d1-4f21-b583-57eb10ec0cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.153764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203067f-86d1-4f21-b583-57eb10ec0cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.153764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203067f-86d1-4f21-b583-57eb10ec0cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.154353 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203067f-86d1-4f21-b583-57eb10ec0cbf admin admin] PATH_INFO: `/v3/projects/105879a82a374ceeacff7ab4cfb45720/users/af44854da3ae4f558051614eb164e15f/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.164840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.175870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203067f-86d1-4f21-b583-57eb10ec0cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=105879a82a374ceeacff7ab4cfb45720, user_id=af44854da3ae4f558051614eb164e15f, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.178943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203067f-86d1-4f21-b583-57eb10ec0cbf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.224106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93066-34ac-4887-ba5a-0568afe86745 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.227815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.228435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.228715 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.228986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.230773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:02.270632 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1165/2347] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:02 2022] PUT /identity/v3/projects/105879a82a374ceeacff7ab4cfb45720/users/af44854da3ae4f558051614eb164e15f/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:02.282755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79075f-ca45-49d3-a2ec-381fdb1aea8c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.283051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79075f-ca45-49d3-a2ec-381fdb1aea8c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.283331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79075f-ca45-49d3-a2ec-381fdb1aea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.304117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.306039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.312656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7f79075f-ca45-49d3-a2ec-381fdb1aea8c None None] MFA Rules not processed for user `af44854da3ae4f558051614eb164e15f`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:02.314066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7f79075f-ca45-49d3-a2ec-381fdb1aea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:02.315267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1183/2348] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:02.382744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1166/2349] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:02.389049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.400720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d7c46-ef2c-47eb-bf74-557c9db04188 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.460054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.460729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.461009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.461316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.462024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.464002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.556721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1184/2350] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:02 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:02.560810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79075f-ca45-49d3-a2ec-381fdb1aea8c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.571536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79075f-ca45-49d3-a2ec-381fdb1aea8c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.631388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.632068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.632356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.632637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.633382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.635293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.746802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1167/2351] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:02 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:02.748255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.759188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e959dd-0d0f-4c1c-9b9f-425df16220c5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.763821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.764474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.764758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.765799 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.766535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.768130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.779557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1185/2352] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:02.783731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.793552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49282ede-92e3-49cf-8fef-681c8efb5cf2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.798459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.799384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.799672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.799944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] PATH_INFO: `/v3/projects/5a6801790cdb478db27fd06ea264e7f6/users/dd980a62d8dd40a2a0db745a85fecb3a/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.815056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6801790cdb478db27fd06ea264e7f6, user_id=dd980a62d8dd40a2a0db745a85fecb3a, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.817802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.886881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1168/2353] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:02 2022] PUT /identity/v3/projects/5a6801790cdb478db27fd06ea264e7f6/users/dd980a62d8dd40a2a0db745a85fecb3a/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:02.891397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.901106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1fc5d-093e-44d3-b647-036893a3f79b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.957506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52affe5d-9545-4e06-b660-b5fecdd750da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.958183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affe5d-9545-4e06-b660-b5fecdd750da admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.958469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affe5d-9545-4e06-b660-b5fecdd750da admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.958749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affe5d-9545-4e06-b660-b5fecdd750da admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.959481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52affe5d-9545-4e06-b660-b5fecdd750da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.961162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52affe5d-9545-4e06-b660-b5fecdd750da admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:02.971405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1186/2354] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:02.975290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:02.985667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637c9ca-bf47-45be-a7d7-2429d4d2636f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:02.992165 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:02.993172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:02.993526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:02.993911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] PATH_INFO: `/v3/projects/5a6801790cdb478db27fd06ea264e7f6/users/dd980a62d8dd40a2a0db745a85fecb3a/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:02.995976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6801790cdb478db27fd06ea264e7f6, user_id=dd980a62d8dd40a2a0db745a85fecb3a, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:02.998860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:03.011943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1169/2355] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:02 2022] PUT /identity/v3/projects/5a6801790cdb478db27fd06ea264e7f6/users/dd980a62d8dd40a2a0db745a85fecb3a/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:03.027157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:03.027595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:03.027872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:03.057462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] MFA Rules not processed for user `dd980a62d8dd40a2a0db745a85fecb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:03.058666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:03.135274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1187/2356] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:03.144856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:03.146650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:03.207663 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c8ac8-84e7-4122-9901-c3019708aede admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:03.211437 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0025912-d159-4e76-ad7b-fcb3986f96e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:03.212162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025912-d159-4e76-ad7b-fcb3986f96e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:03.212442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025912-d159-4e76-ad7b-fcb3986f96e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:03.212821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0025912-d159-4e76-ad7b-fcb3986f96e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:03.269209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0025912-d159-4e76-ad7b-fcb3986f96e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:03.270624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0025912-d159-4e76-ad7b-fcb3986f96e6 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:03.279306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1170/2357] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:04.682580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:04.684001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:04.754216 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c0f3a-a5bb-4e5b-baf8-61347afc8a6a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:04.759243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:04.760123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:04.760413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:04.760690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] PATH_INFO: `/v3/users/fd3e45d80255452cb9c10e6c971c878e` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:04.761936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3e45d80255452cb9c10e6c971c878e)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:04.763850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:05.009607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3e45d80255452cb9c10e6c971c878e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:05.010191 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3e45d80255452cb9c10e6c971c878e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:05.017968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3e45d80255452cb9c10e6c971c878e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:05.029690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3e45d80255452cb9c10e6c971c878e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:05.030337 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3e45d80255452cb9c10e6c971c878e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:05.154459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:05.157462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:05.158017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:05.159880 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1188/2358] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:04 2022] DELETE /identity/v3/users/fd3e45d80255452cb9c10e6c971c878e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:05.180095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:05.181351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:05.256424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1171/2359] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:05.278291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:05.278291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:05.339853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d380d-c640-491e-8e97-110b46837d7b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:05.344647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40596e65-fa98-4d82-9cc3-388a1a098fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:05.345358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40596e65-fa98-4d82-9cc3-388a1a098fdb service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:05.345631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40596e65-fa98-4d82-9cc3-388a1a098fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:05.345938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40596e65-fa98-4d82-9cc3-388a1a098fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:05.355472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40596e65-fa98-4d82-9cc3-388a1a098fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:05.359148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40596e65-fa98-4d82-9cc3-388a1a098fdb service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:05.367654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1189/2360] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:05.824230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:05.825665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:05.921737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be2c57-da29-489a-ace6-a2396f84a121 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:05.927298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:05.928195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:05.928485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:05.928762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] PATH_INFO: `/v3/projects/d9135afa48734c6a93dba0254e734a7d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:05.930090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9135afa48734c6a93dba0254e734a7d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:05.932065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:06.070269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9135afa48734c6a93dba0254e734a7d', 'request_id': 'req-cae8335e-1ded-456c-83d9-a217c3018f19'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:06.137962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9135afa48734c6a93dba0254e734a7d', 'request_id': 'req-cae8335e-1ded-456c-83d9-a217c3018f19'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:06.145816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9135afa48734c6a93dba0254e734a7d', 'request_id': 'req-cae8335e-1ded-456c-83d9-a217c3018f19'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:06.157617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] The token cache is being invalidate because project d9135afa48734c6a93dba0254e734a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:06.158188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:06.158700 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cae8335e-1ded-456c-83d9-a217c3018f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:06.160279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1172/2361] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:05 2022] DELETE /identity/v3/projects/d9135afa48734c6a93dba0254e734a7d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:06.165165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6caf-db4e-4b13-9baf-613bb0c85894 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.165655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6caf-db4e-4b13-9baf-613bb0c85894 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.165747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6caf-db4e-4b13-9baf-613bb0c85894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.216724 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-307f6caf-db4e-4b13-9baf-613bb0c85894 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:06.218167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-307f6caf-db4e-4b13-9baf-613bb0c85894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:06.279124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1190/2362] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:06.287662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0724d9-ad34-4e03-b50b-687bf99794ae None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.287890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0724d9-ad34-4e03-b50b-687bf99794ae None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.288171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0724d9-ad34-4e03-b50b-687bf99794ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.308074 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0e0724d9-ad34-4e03-b50b-687bf99794ae None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:06.309352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0e0724d9-ad34-4e03-b50b-687bf99794ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:06.318136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1173/2363] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:06.322449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f6caf-db4e-4b13-9baf-613bb0c85894 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:06.332335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f6caf-db4e-4b13-9baf-613bb0c85894 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:06.337375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:06.338023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.338308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.338583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.339431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:06.339984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:06.342204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:06.356319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1191/2364] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:22:06.365529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0724d9-ad34-4e03-b50b-687bf99794ae None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:06.375412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0724d9-ad34-4e03-b50b-687bf99794ae None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:06.380075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:06.380736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.381020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.381333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.382082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:06.383970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:06.505936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1174/2365] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:06 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:06.510071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:06.520047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d1172-4204-4362-ac1d-2c7edb418de4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:06.578682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:06.579517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.579767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.580001 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.580747 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:06.582881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:06.676610 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1192/2366] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:06 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:06.680710 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:06.691670 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10b1ce-0451-464e-9ea3-2ce46ffe2edf admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:06.696324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:06.697151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.697432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.697708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.701815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:06.701815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:06.711161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1175/2367] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:06.715339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:06.725789 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7fb43-040e-4a2f-9eb7-35730fc50c0c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:06.730437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1134b3-336a-4e2a-ae6b-bf9eafc89474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:06.731100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1134b3-336a-4e2a-ae6b-bf9eafc89474 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.731379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1134b3-336a-4e2a-ae6b-bf9eafc89474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.731678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1134b3-336a-4e2a-ae6b-bf9eafc89474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.732463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1134b3-336a-4e2a-ae6b-bf9eafc89474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:06.734707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1134b3-336a-4e2a-ae6b-bf9eafc89474 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:06.744906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1193/2368] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:06.749912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:06.759732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae514-af84-48ce-8010-7894036c7d92 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:06.764462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:06.766128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.766428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.766736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] PATH_INFO: `/v3/projects/962afd60656647fca6bdd75e5dbd1d34/users/e7aa63f2ed6540169e5ed9be9b4828fa/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.784288 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] RBAC: Authorizing `identity:create_grant(project_id=962afd60656647fca6bdd75e5dbd1d34, user_id=e7aa63f2ed6540169e5ed9be9b4828fa, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:06.787865 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:06.883330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1176/2369] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:06 2022] PUT /identity/v3/projects/962afd60656647fca6bdd75e5dbd1d34/users/e7aa63f2ed6540169e5ed9be9b4828fa/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:06.895585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:06.895891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:06.896623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:06.929966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] MFA Rules not processed for user `e7aa63f2ed6540169e5ed9be9b4828fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:06.931188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:07.008952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1194/2370] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:07.030041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:07.032045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:07.106892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846418c1-1089-4671-97dd-6ebb8a5b533e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:07.111503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:07.112163 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:07.112449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:07.112727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:07.121355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:07.122838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:07.132541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1177/2371] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:08.813160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:08.814579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:08.881892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc683d-10e5-45fe-a075-ec920be906fa None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:08.886562 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:08.887547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:08.887836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:08.888116 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] PATH_INFO: `/v3/users/545d7575984449b2a1df2c5787cd49e1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:08.890183 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545d7575984449b2a1df2c5787cd49e1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:08.892129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:09.086168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545d7575984449b2a1df2c5787cd49e1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:09.086932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545d7575984449b2a1df2c5787cd49e1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:09.100641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545d7575984449b2a1df2c5787cd49e1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:09.126278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545d7575984449b2a1df2c5787cd49e1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:09.127267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-f19ff12a-8926-46d5-b8b8-cfb9a579cd72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545d7575984449b2a1df2c5787cd49e1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:09.131161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:09.139399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25746d-6034-4960-a6a8-e9ac15dd78e8 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:09.143762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:09.144405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:09.144879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:09.145216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:09.147015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:09.210969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:09.211902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1195/2372] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:08 2022] DELETE /identity/v3/users/545d7575984449b2a1df2c5787cd49e1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:09.212413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:09.216870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:09.217453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:09.217940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:09.223294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1178/2373] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:09.240272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:09.241632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:09.329033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1196/2374] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:09.339064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:09.340653 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:09.435088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c794c9-91be-4267-bf8e-496979261710 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:09.490475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:09.491130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:09.491415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:09.491695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:09.501309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:09.502730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:09.512255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1179/2375] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:09.972776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:09.975988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:09.992013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b11f3-8ba2-4403-9d70-1964f82378eb None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:10.006381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:10.006381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:10.006381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:10.006381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] PATH_INFO: `/v3/projects/5e90fa04f6174b33815cdc7d5fbb8876` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:10.006751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e90fa04f6174b33815cdc7d5fbb8876)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:10.007665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:10.191218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e90fa04f6174b33815cdc7d5fbb8876', 'request_id': 'req-17b33ebe-7fec-4efa-a590-44cf3c0b069b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.263864 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e90fa04f6174b33815cdc7d5fbb8876', 'request_id': 'req-17b33ebe-7fec-4efa-a590-44cf3c0b069b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.271192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e90fa04f6174b33815cdc7d5fbb8876', 'request_id': 'req-17b33ebe-7fec-4efa-a590-44cf3c0b069b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.282375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] The token cache is being invalidate because project 5e90fa04f6174b33815cdc7d5fbb8876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:10.282673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.283453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.285012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1197/2376] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:09 2022] DELETE /identity/v3/projects/5e90fa04f6174b33815cdc7d5fbb8876 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:10.289046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:10.300570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df75da0-aba5-482c-88e2-8a261626d209 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:10.393245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:10.394137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:10.394579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:10.394992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] PATH_INFO: `/v3/users/545d1d5c6a31443facd0184cf982a9be` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:10.396215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545d1d5c6a31443facd0184cf982a9be)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:10.398278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:10.581680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545d1d5c6a31443facd0184cf982a9be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.582427 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545d1d5c6a31443facd0184cf982a9be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.595676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545d1d5c6a31443facd0184cf982a9be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.596446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545d1d5c6a31443facd0184cf982a9be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.603757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545d1d5c6a31443facd0184cf982a9be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:10.693676 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1180/2377] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:10 2022] DELETE /identity/v3/users/545d1d5c6a31443facd0184cf982a9be => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:11.130319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:11.131729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:11.145048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b33ebe-7fec-4efa-a590-44cf3c0b069b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:11.183970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:11.185631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:11.224674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:11.226007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.226476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.227343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] PATH_INFO: `/v3/users/59a42933bf6b45a2b8d8ab7a1e608691` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.234236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a42933bf6b45a2b8d8ab7a1e608691)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:11.236575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:11.277525 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658bcd9-fcb2-4459-962d-59232a5011c2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:11.282546 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:11.285906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.285906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.285906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] PATH_INFO: `/v3/projects/a513d688f12948e6a72697e17324bfb4` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.285906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a513d688f12948e6a72697e17324bfb4)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:11.287063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:11.425514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a42933bf6b45a2b8d8ab7a1e608691'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.426954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a42933bf6b45a2b8d8ab7a1e608691'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.429872 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a513d688f12948e6a72697e17324bfb4', 'request_id': 'req-820daacf-be52-4d97-89df-1228482f0b3c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.435839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a42933bf6b45a2b8d8ab7a1e608691'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.449583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a42933bf6b45a2b8d8ab7a1e608691'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.450677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-994d8731-342a-42ef-94f6-8f7a97564921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a42933bf6b45a2b8d8ab7a1e608691'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.503829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a513d688f12948e6a72697e17324bfb4', 'request_id': 'req-820daacf-be52-4d97-89df-1228482f0b3c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.511581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a513d688f12948e6a72697e17324bfb4', 'request_id': 'req-820daacf-be52-4d97-89df-1228482f0b3c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.524775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] The token cache is being invalidate because project a513d688f12948e6a72697e17324bfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:11.525216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.525957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-820daacf-be52-4d97-89df-1228482f0b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:11.527585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1181/2378] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:11 2022] DELETE /identity/v3/projects/a513d688f12948e6a72697e17324bfb4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:11.533408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ddfe-a695-4ae2-b21d-56e384243093 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.533704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ddfe-a695-4ae2-b21d-56e384243093 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.534517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ddfe-a695-4ae2-b21d-56e384243093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.555287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c936ddfe-a695-4ae2-b21d-56e384243093 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:11.556810 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c936ddfe-a695-4ae2-b21d-56e384243093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:11.574029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1198/2379] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:11 2022] DELETE /identity/v3/users/59a42933bf6b45a2b8d8ab7a1e608691 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:11.576907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.577730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.578273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.632637 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1182/2380] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:11.634548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:11.636187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:11.641010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6cdf7-adc0-4623-9aea-0ad18b349d81 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.641392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6cdf7-adc0-4623-9aea-0ad18b349d81 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.641876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6cdf7-adc0-4623-9aea-0ad18b349d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.663853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-47f6cdf7-adc0-4623-9aea-0ad18b349d81 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:11.665393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-47f6cdf7-adc0-4623-9aea-0ad18b349d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:11.706721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1199/2381] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:11.715065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:11.716547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:11.731723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1183/2382] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:11.736182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6cdf7-adc0-4623-9aea-0ad18b349d81 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:11.744759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6cdf7-adc0-4623-9aea-0ad18b349d81 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:11.750099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:11.750755 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.751037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.751308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.752013 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:11.752317 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:11.754141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:11.770043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1184/2383] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:22:11.778119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:11.779071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21092c-a942-42bb-8e9e-8df748250898 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:11.780871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60803e1-702f-49a7-8a1d-e9e077d99ac9 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:11.783104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:11.783752 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.784038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.784314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.785799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:11.786451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.786758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.787034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.787756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:11.789776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:11.793412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:11.794831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:11.805332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1200/2384] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:11.911652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1185/2385] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:11 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:11.915823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:11.925444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef85a7-2bed-4e99-9b63-0e99b699df66 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:11.983475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:11.984138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:11.984425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:11.984733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:11.985465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:11.987437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.109976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1201/2386] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:11 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:12.114520 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:12.126058 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfebdb-56d1-48cc-abd7-1a3d18d3d295 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:12.131831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:12.133176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.133176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.133176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.135497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:12.136235 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.151685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1186/2387] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:12.152587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:12.164047 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494fc9c-ec3d-4811-8953-d511a47f6811 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:12.174870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:12.175635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.176048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.176394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.177413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:12.179639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.190884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1202/2388] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:12.195359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:12.206265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0e204-db95-4fa0-beb0-1f7c9cb67a63 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:12.211769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f7128-c2f3-4477-93d1-8c3870db6e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:12.212767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7128-c2f3-4477-93d1-8c3870db6e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.221662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7128-c2f3-4477-93d1-8c3870db6e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.221662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7128-c2f3-4477-93d1-8c3870db6e20 admin admin] PATH_INFO: `/v3/projects/a56f34c0cccb4d79bf827b5e6e287cc5/users/975592859a3c4ee6bd28074c62f2890d/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.235940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f7128-c2f3-4477-93d1-8c3870db6e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56f34c0cccb4d79bf827b5e6e287cc5, user_id=975592859a3c4ee6bd28074c62f2890d, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:12.240084 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f7128-c2f3-4477-93d1-8c3870db6e20 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.251437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:12.254748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:12.269417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e4ce-2b9a-4610-a072-3f7af0dd0b96 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:12.279890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:12.279890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.279890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.279890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] PATH_INFO: `/v3/projects/f986b3604f504873a996ea8d00ec0f14` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.280274 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f986b3604f504873a996ea8d00ec0f14)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:12.281256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.356126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1187/2389] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:12 2022] PUT /identity/v3/projects/a56f34c0cccb4d79bf827b5e6e287cc5/users/975592859a3c4ee6bd28074c62f2890d/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:12.367175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.367461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.367733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.394015 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] MFA Rules not processed for user `975592859a3c4ee6bd28074c62f2890d`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:12.395221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:12.424617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f986b3604f504873a996ea8d00ec0f14', 'request_id': 'req-8b2d894f-1629-4a94-9f26-0bf0706e16a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.459114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1188/2390] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:12.469910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:12.471253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:12.480568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f986b3604f504873a996ea8d00ec0f14', 'request_id': 'req-8b2d894f-1629-4a94-9f26-0bf0706e16a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.488492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f986b3604f504873a996ea8d00ec0f14', 'request_id': 'req-8b2d894f-1629-4a94-9f26-0bf0706e16a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.502891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] The token cache is being invalidate because project f986b3604f504873a996ea8d00ec0f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:12.503800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.503976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.505759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1203/2391] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:12 2022] DELETE /identity/v3/projects/f986b3604f504873a996ea8d00ec0f14 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:12.509597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:12.510946 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:12.539625 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd0e13-aa50-4b9f-b702-9e9f707a0565 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:12.577042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d894f-1629-4a94-9f26-0bf0706e16a3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:12.582345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:12.583265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.583553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.583963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] PATH_INFO: `/v3/users/25ec7706a04b4527b63b491627588cea` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.585239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ec7706a04b4527b63b491627588cea)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:12.587168 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.589598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:12.591266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.591266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.591266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.595540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:12.657209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:12.658660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.668669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1189/2392] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:12.693406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:12.695243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:12.712134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66899-258b-4e37-8b5e-c78976d575e9 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:12.717149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:12.719429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:12.719754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:12.720075 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] PATH_INFO: `/v3/users/975592859a3c4ee6bd28074c62f2890d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:12.721421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975592859a3c4ee6bd28074c62f2890d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:12.723419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:12.737726 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ec7706a04b4527b63b491627588cea'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.738500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ec7706a04b4527b63b491627588cea'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.747577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ec7706a04b4527b63b491627588cea'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.768112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ec7706a04b4527b63b491627588cea'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.768905 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7624ea91-c297-4178-899a-3a81adc865a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ec7706a04b4527b63b491627588cea'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.841517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1204/2393] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:12 2022] DELETE /identity/v3/users/25ec7706a04b4527b63b491627588cea => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:12.965901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975592859a3c4ee6bd28074c62f2890d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.966589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975592859a3c4ee6bd28074c62f2890d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.978666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975592859a3c4ee6bd28074c62f2890d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.979298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975592859a3c4ee6bd28074c62f2890d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:12.986186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975592859a3c4ee6bd28074c62f2890d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:13.106590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1190/2394] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:12 2022] DELETE /identity/v3/users/975592859a3c4ee6bd28074c62f2890d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:13.111775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:13.112080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:13.112358 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:13.135465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:13.135892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:13.283274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:13.284530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:13.396992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1205/2395] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:13.404734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:13.407209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:13.419930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692af650-655c-4209-8edf-186fac9eeed3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:13.425622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:13.426831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:13.429344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:13.430684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] PATH_INFO: `/v3/projects/2b4da38aeace4c12be620377eda599f4` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:13.432310 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4da38aeace4c12be620377eda599f4)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:13.434321 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:13.500103 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4ac9-d6c7-4684-b234-a0c86c97bc6b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:13.504091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcfdfc-83e6-43da-9da4-5c13510b8b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:13.507554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcfdfc-83e6-43da-9da4-5c13510b8b21 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:13.507554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcfdfc-83e6-43da-9da4-5c13510b8b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:13.507554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcfdfc-83e6-43da-9da4-5c13510b8b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:13.514884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcfdfc-83e6-43da-9da4-5c13510b8b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:13.516420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcfdfc-83e6-43da-9da4-5c13510b8b21 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:13.527305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1206/2396] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:13.577011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4da38aeace4c12be620377eda599f4', 'request_id': 'req-b277730b-e6ad-4209-be77-f2e230d508eb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:13.675507 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4da38aeace4c12be620377eda599f4', 'request_id': 'req-b277730b-e6ad-4209-be77-f2e230d508eb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:13.682344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4da38aeace4c12be620377eda599f4', 'request_id': 'req-b277730b-e6ad-4209-be77-f2e230d508eb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:13.694548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] The token cache is being invalidate because project 2b4da38aeace4c12be620377eda599f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:13.694840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:13.695493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-b277730b-e6ad-4209-be77-f2e230d508eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:13.697148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1191/2397] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:13 2022] DELETE /identity/v3/projects/2b4da38aeace4c12be620377eda599f4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:13.703878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6db62-b0f5-485e-ac80-9a5575705718 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:13.704398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6db62-b0f5-485e-ac80-9a5575705718 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:13.705032 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6db62-b0f5-485e-ac80-9a5575705718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:13.740021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-30c6db62-b0f5-485e-ac80-9a5575705718 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:13.741570 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-30c6db62-b0f5-485e-ac80-9a5575705718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:13.819705 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1207/2398] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:13.829860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5dd3e-92d2-4117-8024-355f3d73021f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:13.830494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5dd3e-92d2-4117-8024-355f3d73021f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:13.831177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5dd3e-92d2-4117-8024-355f3d73021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:13.860311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2ab5dd3e-92d2-4117-8024-355f3d73021f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:13.861896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2ab5dd3e-92d2-4117-8024-355f3d73021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:13.871641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1192/2399] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:13.876379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6db62-b0f5-485e-ac80-9a5575705718 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:13.893851 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6db62-b0f5-485e-ac80-9a5575705718 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:13.901172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:13.902450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:13.902994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:13.903483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:13.904567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:13.905254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:13.909582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:13.926917 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1208/2400] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:22:13.933155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5dd3e-92d2-4117-8024-355f3d73021f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:13.948041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5dd3e-92d2-4117-8024-355f3d73021f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:13.958739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:13.959445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:13.959734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:13.960011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:13.961654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:13.962752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:14.146201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1193/2401] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:13 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:14.150285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:14.160810 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588a93-e359-4b7a-9f19-72ee1a9cc516 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:14.176043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:14.178564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:14.254020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:14.268357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:14.268357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:14.268357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:14.268357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:14.268357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:14.292484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c55836-4f2b-4952-8e5d-0daa0d10e591 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:14.294799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:14.296311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:14.297354 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:14.297739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] PATH_INFO: `/v3/projects/a56f34c0cccb4d79bf827b5e6e287cc5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:14.299044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56f34c0cccb4d79bf827b5e6e287cc5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:14.301096 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:14.379326 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1209/2402] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:14 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:14.384266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:14.395923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72692df-a090-459d-af7e-b83b3771ef5b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:14.401249 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:14.402237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:14.402725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:14.403065 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:14.403897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:14.405996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:14.421561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1210/2403] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:14.425697 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:14.441039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b50790-da18-4516-a4df-077aafee0b83 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:14.447081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:14.447757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:14.448034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:14.448301 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:14.449246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:14.450828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:14.462460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1211/2404] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:14.466833 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:14.477565 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be5dbc-fb35-417e-a5d3-442ac20dba8f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:14.482418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6ad5f-4eb8-4e4d-9b6b-8509c1419997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:14.483327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6ad5f-4eb8-4e4d-9b6b-8509c1419997 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:14.483609 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6ad5f-4eb8-4e4d-9b6b-8509c1419997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:14.483878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6ad5f-4eb8-4e4d-9b6b-8509c1419997 admin admin] PATH_INFO: `/v3/projects/bce9a2accde947c08b8cb64a1fc32311/users/4ddc456cdbd94bb287154b961f7d376d/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:14.498332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6ad5f-4eb8-4e4d-9b6b-8509c1419997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce9a2accde947c08b8cb64a1fc32311, user_id=4ddc456cdbd94bb287154b961f7d376d, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:14.501133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6ad5f-4eb8-4e4d-9b6b-8509c1419997 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:14.618033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1212/2405] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:14 2022] PUT /identity/v3/projects/bce9a2accde947c08b8cb64a1fc32311/users/4ddc456cdbd94bb287154b961f7d376d/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:14.623512 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:14.623972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:14.624328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:14.626888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56f34c0cccb4d79bf827b5e6e287cc5', 'request_id': 'req-f0c2dd4c-8527-4777-9c60-42f934bceced'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:14.647581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:14.648992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:14.697619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56f34c0cccb4d79bf827b5e6e287cc5', 'request_id': 'req-f0c2dd4c-8527-4777-9c60-42f934bceced'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:14.706651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56f34c0cccb4d79bf827b5e6e287cc5', 'request_id': 'req-f0c2dd4c-8527-4777-9c60-42f934bceced'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:14.715711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1213/2406] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:14.721341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] The token cache is being invalidate because project a56f34c0cccb4d79bf827b5e6e287cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:14.721723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:14.722460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:14.724059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1194/2407] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:14 2022] DELETE /identity/v3/projects/a56f34c0cccb4d79bf827b5e6e287cc5 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:14.727500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:14.728829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:14.798524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f742e-64ab-4909-9488-430dd81c9b98 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:14.802671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28837e80-0157-4b38-adc0-4bd3b41c326f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:14.803354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837e80-0157-4b38-adc0-4bd3b41c326f service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:14.803634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837e80-0157-4b38-adc0-4bd3b41c326f service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:14.803910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28837e80-0157-4b38-adc0-4bd3b41c326f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:14.806055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-28837e80-0157-4b38-adc0-4bd3b41c326f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:14.821941 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28837e80-0157-4b38-adc0-4bd3b41c326f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:14.823515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28837e80-0157-4b38-adc0-4bd3b41c326f service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:14.841550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1214/2408] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:15.384574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:15.386042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:15.398826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2dd4c-8527-4777-9c60-42f934bceced admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:15.408577 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:15.409384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:15.410173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:15.410173 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] PATH_INFO: `/v3/users/af44854da3ae4f558051614eb164e15f` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:15.411366 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af44854da3ae4f558051614eb164e15f)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:15.413670 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:15.578445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af44854da3ae4f558051614eb164e15f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:15.579350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af44854da3ae4f558051614eb164e15f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:15.592402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af44854da3ae4f558051614eb164e15f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:15.593807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af44854da3ae4f558051614eb164e15f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:15.600898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af44854da3ae4f558051614eb164e15f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:15.649114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1195/2409] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:15 2022] DELETE /identity/v3/users/af44854da3ae4f558051614eb164e15f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:15.653635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f701-2a4b-4c5d-b911-c535637f65c2 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:15.654073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f701-2a4b-4c5d-b911-c535637f65c2 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:15.654357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77f701-2a4b-4c5d-b911-c535637f65c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:15.673594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-3f77f701-2a4b-4c5d-b911-c535637f65c2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:15.677102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3f77f701-2a4b-4c5d-b911-c535637f65c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:15.746532 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1215/2410] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:15.757033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:15.758523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:15.818951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982415-c01e-4094-8fc7-6de848bbad32 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:15.822727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:15.823374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:15.823658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:15.823934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:15.840564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:15.842293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:15.852935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1196/2411] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:16.210004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.210543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.211075 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.246679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] MFA Rules not processed for user `4ddc456cdbd94bb287154b961f7d376d`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:16.248192 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:16.318012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1216/2412] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:16.322471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.324046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:16.337211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8bd8e-6788-4727-99fe-55189d10b472 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.341881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:16.342685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.342932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.343176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.344089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:16.346133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:16.375621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.376862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:16.393699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a8a18-2b89-4952-a5a1-d6c12955ec38 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.399254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:16.401196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.401196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.401196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] PATH_INFO: `/v3/projects/105879a82a374ceeacff7ab4cfb45720` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.402428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105879a82a374ceeacff7ab4cfb45720)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:16.404723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:16.420587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1197/2413] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:16.428481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.525219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693578-a58f-4021-925c-33a7a8feb20c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.544991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105879a82a374ceeacff7ab4cfb45720', 'request_id': 'req-765accd2-2510-435d-b78f-0bebf53fbb58'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.591586 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:16.592259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.592551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.593811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.594312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:16.596274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:16.624293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105879a82a374ceeacff7ab4cfb45720', 'request_id': 'req-765accd2-2510-435d-b78f-0bebf53fbb58'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.630158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105879a82a374ceeacff7ab4cfb45720', 'request_id': 'req-765accd2-2510-435d-b78f-0bebf53fbb58'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.641787 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] The token cache is being invalidate because project 105879a82a374ceeacff7ab4cfb45720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:16.642093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.642754 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.644289 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1217/2414] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:16 2022] DELETE /identity/v3/projects/105879a82a374ceeacff7ab4cfb45720 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:16.648079 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.649447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:16.662120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765accd2-2510-435d-b78f-0bebf53fbb58 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.666858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:16.667716 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.667954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.668234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] PATH_INFO: `/v3/users/dd980a62d8dd40a2a0db745a85fecb3a` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.669463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd980a62d8dd40a2a0db745a85fecb3a)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:16.671587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:16.725896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1198/2415] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:16 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:16.729862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.731631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:16.742996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbd30b-1b04-435a-aa7e-48bf6377608f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.747649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:16.748272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.748579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.748875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.749599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:16.751162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:16.761089 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1199/2416] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:16.765543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.774779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67098ec1-06be-408d-b53d-873a66939041 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.779410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:16.780833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.781458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.781458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] PATH_INFO: `/v3/projects/226e87a9d4bd4db38983edfb10424fe0/users/1571001e5d2a4f3982d805a52de7cdeb/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.795369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226e87a9d4bd4db38983edfb10424fe0, user_id=1571001e5d2a4f3982d805a52de7cdeb, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:16.798107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:16.892944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1200/2417] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:16 2022] PUT /identity/v3/projects/226e87a9d4bd4db38983edfb10424fe0/users/1571001e5d2a4f3982d805a52de7cdeb/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:16.897108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.901659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd980a62d8dd40a2a0db745a85fecb3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.902840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd980a62d8dd40a2a0db745a85fecb3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.910618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd980a62d8dd40a2a0db745a85fecb3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.922361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd980a62d8dd40a2a0db745a85fecb3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.922980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd980a62d8dd40a2a0db745a85fecb3a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:16.957721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da7378-3943-421a-97e1-3f3b8b8c7770 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.962411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:16.963080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:16.963365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:16.963644 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:16.964367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:16.965975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:16.976019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1201/2418] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:16.980159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:16.981964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:16.994134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362501b3-c9cf-4938-9673-33e4c4798d51 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:16.999354 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2684f-b033-437a-9dbc-39c2e2c20596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:17.000305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2684f-b033-437a-9dbc-39c2e2c20596 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:17.000585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2684f-b033-437a-9dbc-39c2e2c20596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:17.000866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2684f-b033-437a-9dbc-39c2e2c20596 admin admin] PATH_INFO: `/v3/projects/226e87a9d4bd4db38983edfb10424fe0/users/1571001e5d2a4f3982d805a52de7cdeb/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:17.002869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2684f-b033-437a-9dbc-39c2e2c20596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226e87a9d4bd4db38983edfb10424fe0, user_id=1571001e5d2a4f3982d805a52de7cdeb, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:17.005509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2684f-b033-437a-9dbc-39c2e2c20596 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:17.016478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1218/2419] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:16 2022] DELETE /identity/v3/users/dd980a62d8dd40a2a0db745a85fecb3a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:17.016658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1202/2420] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:16 2022] PUT /identity/v3/projects/226e87a9d4bd4db38983edfb10424fe0/users/1571001e5d2a4f3982d805a52de7cdeb/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:17.563117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:17.564051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:17.666022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338f54a-10be-4dc4-b8c5-721fc5cd9295 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:17.673901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:17.674850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:17.675131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:17.675634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] PATH_INFO: `/v3/projects/5a6801790cdb478db27fd06ea264e7f6` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:17.677730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6801790cdb478db27fd06ea264e7f6)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:17.684025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:17.806806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6801790cdb478db27fd06ea264e7f6', 'request_id': 'req-deac0436-7058-4490-9b60-d5bc12e8016d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:17.877875 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6801790cdb478db27fd06ea264e7f6', 'request_id': 'req-deac0436-7058-4490-9b60-d5bc12e8016d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:17.884430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6801790cdb478db27fd06ea264e7f6', 'request_id': 'req-deac0436-7058-4490-9b60-d5bc12e8016d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:17.896962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] The token cache is being invalidate because project 5a6801790cdb478db27fd06ea264e7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:17.897288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:17.897943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-deac0436-7058-4490-9b60-d5bc12e8016d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:17.899641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1219/2421] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:17 2022] DELETE /identity/v3/projects/5a6801790cdb478db27fd06ea264e7f6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:17.905914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53800-aa5a-4e0f-9b13-436b99fad42e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:17.906408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53800-aa5a-4e0f-9b13-436b99fad42e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:17.906517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53800-aa5a-4e0f-9b13-436b99fad42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:17.925214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-61d53800-aa5a-4e0f-9b13-436b99fad42e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:17.926452 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-61d53800-aa5a-4e0f-9b13-436b99fad42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:17.986494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1203/2422] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:17.995028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82115727-4b32-4eed-913a-f37d93997b65 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:17.995517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82115727-4b32-4eed-913a-f37d93997b65 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:17.995892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82115727-4b32-4eed-913a-f37d93997b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.016083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-82115727-4b32-4eed-913a-f37d93997b65 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:18.017316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-82115727-4b32-4eed-913a-f37d93997b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:18.025777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1220/2423] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:18.029991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53800-aa5a-4e0f-9b13-436b99fad42e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.040135 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53800-aa5a-4e0f-9b13-436b99fad42e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.047254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.047254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.047254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.047254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.047655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:18.047923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.049551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.063164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1204/2424] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:22:18.067491 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82115727-4b32-4eed-913a-f37d93997b65 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.077446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82115727-4b32-4eed-913a-f37d93997b65 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.082154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff785eb-1cbe-42b2-9f2a-a03cb6c260cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.082839 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff785eb-1cbe-42b2-9f2a-a03cb6c260cb admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.084132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff785eb-1cbe-42b2-9f2a-a03cb6c260cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.084132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff785eb-1cbe-42b2-9f2a-a03cb6c260cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.084132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff785eb-1cbe-42b2-9f2a-a03cb6c260cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.085972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff785eb-1cbe-42b2-9f2a-a03cb6c260cb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.270813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1221/2425] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:18.274958 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.285557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c886-0972-4b9f-a791-e958ef09a0a3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.344774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.345652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.345944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.346221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.346915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.348897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.402151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51608e34-92e8-4f69-95a7-2b6c177aeb52 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.402613 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51608e34-92e8-4f69-95a7-2b6c177aeb52 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.402743 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51608e34-92e8-4f69-95a7-2b6c177aeb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.431392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-51608e34-92e8-4f69-95a7-2b6c177aeb52 None None] MFA Rules not processed for user `1571001e5d2a4f3982d805a52de7cdeb`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:18.432635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-51608e34-92e8-4f69-95a7-2b6c177aeb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:18.454193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1205/2426] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:18 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:18.457855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.472675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4673f-1da8-4bf7-929f-85b2116fc644 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.479162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.480032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.480551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.480934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.481790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.485295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.504149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1206/2427] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:18.505394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.514354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1222/2428] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:18.516231 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cebad9-e0e5-4e0c-a632-68e07c5f3064 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.521628 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.522338 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.522692 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.523042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.523833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.525640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.536779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1207/2429] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:18.540764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51608e34-92e8-4f69-95a7-2b6c177aeb52 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.551950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51608e34-92e8-4f69-95a7-2b6c177aeb52 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.556597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde8db-35c1-4e3c-a0a9-986851825597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.557494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde8db-35c1-4e3c-a0a9-986851825597 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.557773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde8db-35c1-4e3c-a0a9-986851825597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.558073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde8db-35c1-4e3c-a0a9-986851825597 admin admin] PATH_INFO: `/v3/projects/c36b74bedef34cee8c17e942436c3754/users/f9446eb50e194ce6b0f93a052b29ba0f/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.573434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.575145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:18.575267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fde8db-35c1-4e3c-a0a9-986851825597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36b74bedef34cee8c17e942436c3754, user_id=f9446eb50e194ce6b0f93a052b29ba0f, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.579139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fde8db-35c1-4e3c-a0a9-986851825597 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.630559 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf4165-2164-4e83-bea2-19d00ba46634 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.634183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.634818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.635096 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.635365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.637115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:18.653288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1223/2430] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:18 2022] PUT /identity/v3/projects/c36b74bedef34cee8c17e942436c3754/users/f9446eb50e194ce6b0f93a052b29ba0f/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:18.664845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073142-777d-414e-a65a-18c82e500348 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.665221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073142-777d-414e-a65a-18c82e500348 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.665435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073142-777d-414e-a65a-18c82e500348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.694069 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-46073142-777d-414e-a65a-18c82e500348 None None] MFA Rules not processed for user `f9446eb50e194ce6b0f93a052b29ba0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:18.695354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-46073142-777d-414e-a65a-18c82e500348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:18.711125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.712570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.721511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1208/2431] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:18.772320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1224/2432] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:18.776821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.791764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e755d7-c89e-465f-8c3b-0e2670e3e42c service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:18.864464 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:18.864724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:18.864996 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:18.865306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:18.866181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:18.868911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:18.963183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1209/2433] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:18.968259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073142-777d-414e-a65a-18c82e500348 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:18.979243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073142-777d-414e-a65a-18c82e500348 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.035490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.036084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.036359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.036628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.037347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.039475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.127882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1225/2434] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:18 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:19.131260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.142461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3d295-7cd0-4448-b7c4-31e2aa8d52d5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.148444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.149620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.149903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.150207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.150934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.152560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.164219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1210/2435] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:19.168398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.178394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debff83-4858-4132-8978-e4d1d45aa9b7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.183048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b980add-8ead-49f4-85a4-7c6ded8f4df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.183717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980add-8ead-49f4-85a4-7c6ded8f4df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.183997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980add-8ead-49f4-85a4-7c6ded8f4df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.184271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980add-8ead-49f4-85a4-7c6ded8f4df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.184989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b980add-8ead-49f4-85a4-7c6ded8f4df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.187098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b980add-8ead-49f4-85a4-7c6ded8f4df8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.197187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1226/2436] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:19.201394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.212260 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa2e8e-4ba0-43c8-b326-7b844d1389b2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.217054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.218181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.218460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.218733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] PATH_INFO: `/v3/projects/163a2607ca7649d8a7ac13e8d816db30/users/b2b867df304540019590d03ce894c44e/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.233959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163a2607ca7649d8a7ac13e8d816db30, user_id=b2b867df304540019590d03ce894c44e, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.236595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.303319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1211/2437] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:19 2022] PUT /identity/v3/projects/163a2607ca7649d8a7ac13e8d816db30/users/b2b867df304540019590d03ce894c44e/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:19.315261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6013-9004-4fe4-a398-1ec16c53f780 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.315547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6013-9004-4fe4-a398-1ec16c53f780 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.315842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6013-9004-4fe4-a398-1ec16c53f780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.353758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-89bd6013-9004-4fe4-a398-1ec16c53f780 None None] MFA Rules not processed for user `b2b867df304540019590d03ce894c44e`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:19.355031 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-89bd6013-9004-4fe4-a398-1ec16c53f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:19.427994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1227/2438] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:19.429587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.490901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20d698-fc85-407e-a759-6128a97a92d7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.495916 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.496579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.496866 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.497303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.497884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.499777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.607064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1212/2439] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:19 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:19.611437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6013-9004-4fe4-a398-1ec16c53f780 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.622569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6013-9004-4fe4-a398-1ec16c53f780 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.678684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.679381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.679667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.679948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.680646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.682602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.720082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.721858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:19.734268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652016b-acf6-40dc-a0c5-4c906cdc8ad5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.738944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.742117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.742117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.742117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] PATH_INFO: `/v3/users/e7aa63f2ed6540169e5ed9be9b4828fa` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.742117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7aa63f2ed6540169e5ed9be9b4828fa)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.743456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.795115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1228/2440] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:19 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:19.799015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.808344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b21d14-99fb-4146-8778-a02572ac6933 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.813306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.813948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.814234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.814515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.815228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.816870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.826877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1229/2441] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:19.831762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.840891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733d7b-2168-4a7c-a28c-a3d618c01aef admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:19.846135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:19.846972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:19.847261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:19.847821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] PATH_INFO: `/v3/projects/27a6a032a91748d0bb62b3fda17460e1/users/418db6e3ee1a45b490f03bd931c8667c/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:19.862057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a6a032a91748d0bb62b3fda17460e1, user_id=418db6e3ee1a45b490f03bd931c8667c, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:19.864782 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:19.957415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7aa63f2ed6540169e5ed9be9b4828fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:19.958067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7aa63f2ed6540169e5ed9be9b4828fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:19.971010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7aa63f2ed6540169e5ed9be9b4828fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:19.972364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7aa63f2ed6540169e5ed9be9b4828fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:19.977834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1230/2442] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:19 2022] PUT /identity/v3/projects/27a6a032a91748d0bb62b3fda17460e1/users/418db6e3ee1a45b490f03bd931c8667c/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:19.977834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:19.980409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-23232465-abc5-4543-bdcc-c621658ea257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7aa63f2ed6540169e5ed9be9b4828fa'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:19.980733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.046265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1213/2443] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:19 2022] DELETE /identity/v3/users/e7aa63f2ed6540169e5ed9be9b4828fa => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:20.047268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6142fc-904d-446e-ad3f-9b9a6e569742 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:20.051003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.051294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.051579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.070904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:20.072470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.115544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:20.116298 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.116863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.117173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.118313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:20.120370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:20.134219 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1231/2444] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:20.137899 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:20.147588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1214/2445] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:20.150095 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655b81-58af-4c09-948b-8b171732da67 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:20.156416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eadf3a-244b-413a-961c-f6d1d4012018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:20.157420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eadf3a-244b-413a-961c-f6d1d4012018 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.157769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eadf3a-244b-413a-961c-f6d1d4012018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.158112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eadf3a-244b-413a-961c-f6d1d4012018 admin admin] PATH_INFO: `/v3/projects/27a6a032a91748d0bb62b3fda17460e1/users/418db6e3ee1a45b490f03bd931c8667c/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.160403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eadf3a-244b-413a-961c-f6d1d4012018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a6a032a91748d0bb62b3fda17460e1, user_id=418db6e3ee1a45b490f03bd931c8667c, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:20.160795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:20.162343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.163722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eadf3a-244b-413a-961c-f6d1d4012018 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:20.176611 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1232/2446] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:20 2022] PUT /identity/v3/projects/27a6a032a91748d0bb62b3fda17460e1/users/418db6e3ee1a45b490f03bd931c8667c/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:20.185683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.185971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.186259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.222732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] MFA Rules not processed for user `418db6e3ee1a45b490f03bd931c8667c`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:20.224028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.235805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457b163-e409-4207-9201-4fcee8935f00 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:20.296435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:20.297146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.297432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.297705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.306147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1233/2447] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:20.316753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:20.318268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.361785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:20.363438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:20.373257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1215/2448] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:20.374190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290d1a0-6a5f-42c7-a6a2-0782417ce332 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:20.378158 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:20.378806 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.379090 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.379474 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.381244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.439603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:20.441054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.445975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:20.447628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:20.453914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebed38-f0c7-49da-9b98-1a5072c9488b service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:20.457875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7d92b-2e79-4b55-9dd2-1d3927380b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:20.458554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d92b-2e79-4b55-9dd2-1d3927380b73 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.458848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d92b-2e79-4b55-9dd2-1d3927380b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.459117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d92b-2e79-4b55-9dd2-1d3927380b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.461149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1234/2449] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:20.463699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f7b7d92b-2e79-4b55-9dd2-1d3927380b73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.527323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7d92b-2e79-4b55-9dd2-1d3927380b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:20.528839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7d92b-2e79-4b55-9dd2-1d3927380b73 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:20.539991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1216/2450] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:20.803104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:20.804573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:20.818979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34415a-e694-4f68-b176-3dc17718476d service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:20.823646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:20.824504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:20.824786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:20.825060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] PATH_INFO: `/v3/projects/962afd60656647fca6bdd75e5dbd1d34` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:20.826309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=962afd60656647fca6bdd75e5dbd1d34)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:20.828689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:20.996477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962afd60656647fca6bdd75e5dbd1d34', 'request_id': 'req-a662168e-1a5e-43d2-88f7-adaa5848ac9c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:21.075188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962afd60656647fca6bdd75e5dbd1d34', 'request_id': 'req-a662168e-1a5e-43d2-88f7-adaa5848ac9c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:21.083440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962afd60656647fca6bdd75e5dbd1d34', 'request_id': 'req-a662168e-1a5e-43d2-88f7-adaa5848ac9c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:21.096979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] The token cache is being invalidate because project 962afd60656647fca6bdd75e5dbd1d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:21.107261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:21.107261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-a662168e-1a5e-43d2-88f7-adaa5848ac9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:21.107261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1235/2451] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:20 2022] DELETE /identity/v3/projects/962afd60656647fca6bdd75e5dbd1d34 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:21.107538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b81264-9469-4732-9d7a-56b4702e7563 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.107538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b81264-9469-4732-9d7a-56b4702e7563 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.107538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b81264-9469-4732-9d7a-56b4702e7563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.124965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b9b81264-9469-4732-9d7a-56b4702e7563 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:21.126311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b9b81264-9469-4732-9d7a-56b4702e7563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:21.209052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1217/2452] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:21.209985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e588bbb-e48f-4c50-8c85-3b2b53890f65 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.210351 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e588bbb-e48f-4c50-8c85-3b2b53890f65 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.210739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e588bbb-e48f-4c50-8c85-3b2b53890f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.237642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-5e588bbb-e48f-4c50-8c85-3b2b53890f65 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:21.237642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5e588bbb-e48f-4c50-8c85-3b2b53890f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:21.244636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1236/2453] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:22:21.248571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b81264-9469-4732-9d7a-56b4702e7563 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:21.261442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b81264-9469-4732-9d7a-56b4702e7563 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:21.273438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:21.274389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.274836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.275313 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.276266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:21.276576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:21.278275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:21.297185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1218/2454] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:22:21.299445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e588bbb-e48f-4c50-8c85-3b2b53890f65 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:21.322234 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e588bbb-e48f-4c50-8c85-3b2b53890f65 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:21.339930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:21.340675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.341062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.342048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.344138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:21.349021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:21.464286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1237/2455] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:21 2022] POST /identity/v3/projects => generated 397 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:21.468854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:21.478831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316d408-4200-4a25-8c2f-7c637c6c18ba admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:21.540126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:21.540831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.541187 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.541466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.542185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:21.544116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:21.674469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1219/2456] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:21 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:21.678581 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:21.689561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbb87a-f869-4039-bd3b-207c56dcb57c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:21.693994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:21.694635 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.694915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.695246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.695987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:21.697604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:21.708996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1238/2457] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:21.712910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:21.722807 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae477d22-de95-4c45-b3b0-fd9010fd9b94 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:21.727405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99377b68-5d06-4833-a40e-a2fac3885e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:21.728070 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377b68-5d06-4833-a40e-a2fac3885e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.728352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377b68-5d06-4833-a40e-a2fac3885e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.728626 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99377b68-5d06-4833-a40e-a2fac3885e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.729369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377b68-5d06-4833-a40e-a2fac3885e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:21.730981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99377b68-5d06-4833-a40e-a2fac3885e04 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:21.741171 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1220/2458] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:21.745313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:21.756063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425718e-0ef3-48b5-9fc0-50c8897fde44 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:21.760777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:21.761792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.762085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.762362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] PATH_INFO: `/v3/projects/cccf4ede6b174e2191fae8ca01398513/users/a670302ff76641c998d854a70a34c04a/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.777626 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccf4ede6b174e2191fae8ca01398513, user_id=a670302ff76641c998d854a70a34c04a, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:21.780745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:21.840272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1239/2459] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:21 2022] PUT /identity/v3/projects/cccf4ede6b174e2191fae8ca01398513/users/a670302ff76641c998d854a70a34c04a/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:21.851517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b40a-3e6a-4d9a-b3f2-16a7e7314f37 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:21.851861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b40a-3e6a-4d9a-b3f2-16a7e7314f37 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:21.852146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b40a-3e6a-4d9a-b3f2-16a7e7314f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:21.880552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-2fb5b40a-3e6a-4d9a-b3f2-16a7e7314f37 None None] MFA Rules not processed for user `a670302ff76641c998d854a70a34c04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:21.881772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-2fb5b40a-3e6a-4d9a-b3f2-16a7e7314f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:21.947675 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1221/2460] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:21.958986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:21.960737 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:22.018435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc836bef-cab5-4c7d-8006-518e1faef072 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:22.022109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:22.022757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:22.023037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:22.025102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:22.032704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:22.034221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:22.043045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1240/2461] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:23.362311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b40a-3e6a-4d9a-b3f2-16a7e7314f37 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:23.371909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b40a-3e6a-4d9a-b3f2-16a7e7314f37 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:23.376944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:23.377631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:23.377923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:23.378202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:23.379949 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:23.440764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:23.442415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:23.451907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1222/2462] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:25.114887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:25.116282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:25.128814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10fca-435c-40ec-983b-a365968b71af service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:25.132748 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f9773-e445-4ed8-9d15-fde51fee1688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:25.133421 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f9773-e445-4ed8-9d15-fde51fee1688 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:25.133708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f9773-e445-4ed8-9d15-fde51fee1688 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:25.133987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f9773-e445-4ed8-9d15-fde51fee1688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:25.135887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ac3f9773-e445-4ed8-9d15-fde51fee1688 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:25.200954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f9773-e445-4ed8-9d15-fde51fee1688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:25.202976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f9773-e445-4ed8-9d15-fde51fee1688 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:25.212695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1241/2463] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:33.682890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:33.753783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42060c-b6cf-4461-b84c-ce12cc3db693 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:33.758372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:33.759245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:33.759528 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:33.759803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] PATH_INFO: `/v3/users/a670302ff76641c998d854a70a34c04a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:33.761024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a670302ff76641c998d854a70a34c04a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:33.762949 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:33.970479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a670302ff76641c998d854a70a34c04a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:33.971154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a670302ff76641c998d854a70a34c04a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:33.983423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a670302ff76641c998d854a70a34c04a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:33.984077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a670302ff76641c998d854a70a34c04a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:33.991540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a670302ff76641c998d854a70a34c04a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:34.074937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1223/2464] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:33 2022] DELETE /identity/v3/users/a670302ff76641c998d854a70a34c04a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:34.082678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:34.083196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:34.083290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:34.103499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:34.104780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:34.165104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1242/2465] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:34.174979 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:34.176414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:34.239279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be02c4a-0dc0-4416-b8b7-5d87bc009b81 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:34.242855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0925b-6915-41fa-b1ab-1e18c87c8da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:34.243523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0925b-6915-41fa-b1ab-1e18c87c8da5 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:34.249056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0925b-6915-41fa-b1ab-1e18c87c8da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:34.249056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0925b-6915-41fa-b1ab-1e18c87c8da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:34.259137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0925b-6915-41fa-b1ab-1e18c87c8da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:34.260473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0925b-6915-41fa-b1ab-1e18c87c8da5 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:34.281514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1224/2466] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:34.736873 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:34.738529 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:34.752809 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bded1b6-7354-4b4f-8532-2d012bdea34c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:34.764702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:34.766765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:34.767149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:34.767569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] PATH_INFO: `/v3/projects/cccf4ede6b174e2191fae8ca01398513` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:34.770511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccf4ede6b174e2191fae8ca01398513)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:34.778840 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:34.886931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccf4ede6b174e2191fae8ca01398513', 'request_id': 'req-1c876529-5edd-4c9b-8905-50a3fed9bab5'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:34.954223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccf4ede6b174e2191fae8ca01398513', 'request_id': 'req-1c876529-5edd-4c9b-8905-50a3fed9bab5'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:34.960648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccf4ede6b174e2191fae8ca01398513', 'request_id': 'req-1c876529-5edd-4c9b-8905-50a3fed9bab5'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:34.972325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] The token cache is being invalidate because project cccf4ede6b174e2191fae8ca01398513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:34.974543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:34.974543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-1c876529-5edd-4c9b-8905-50a3fed9bab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:34.974777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1243/2467] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:34 2022] DELETE /identity/v3/projects/cccf4ede6b174e2191fae8ca01398513 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:34.979789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a780c2-2a69-40d4-a51e-d95bf3c11353 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:34.980241 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a780c2-2a69-40d4-a51e-d95bf3c11353 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:34.980352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a780c2-2a69-40d4-a51e-d95bf3c11353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.008001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d3a780c2-2a69-40d4-a51e-d95bf3c11353 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:35.009296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d3a780c2-2a69-40d4-a51e-d95bf3c11353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:35.069726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1225/2468] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:35.078624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f057f6-a164-4e04-af54-d9adef83700c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.078936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f057f6-a164-4e04-af54-d9adef83700c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.079241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f057f6-a164-4e04-af54-d9adef83700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.097228 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f8f057f6-a164-4e04-af54-d9adef83700c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:35.098428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f8f057f6-a164-4e04-af54-d9adef83700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:35.106586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1244/2469] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:35.110703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a780c2-2a69-40d4-a51e-d95bf3c11353 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.120128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a780c2-2a69-40d4-a51e-d95bf3c11353 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.125543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.126199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.126485 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.126761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.127473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:35.127779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.129438 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.142000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1226/2470] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:22:35.146831 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f057f6-a164-4e04-af54-d9adef83700c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.156140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f057f6-a164-4e04-af54-d9adef83700c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.160788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.161466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.161749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.162024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.162822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.164777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.265259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1245/2471] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:35 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:35.269693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.280602 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a5f1-745d-44b3-a068-2cf5d27e4ffa admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.340073 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.340649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.345254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.345254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.345254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.345254 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.443938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.445901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:35.452890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1227/2472] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:35 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:35.456719 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.459616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d510f-cf3a-4f58-9f50-44fec03feff1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.464422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.465331 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.465701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.465967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] PATH_INFO: `/v3/users/f9446eb50e194ce6b0f93a052b29ba0f` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.466796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150ab17-047b-42cc-be24-7d5d925a266f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.468499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9446eb50e194ce6b0f93a052b29ba0f)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.470039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.473425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.474098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.474380 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.474658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.475382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.476965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.491023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1228/2473] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:35.496396 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.517344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9364da-a0c4-4da4-b47a-545a71710ee2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.526328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.527003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.527285 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.527556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.528283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.530054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.549259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1229/2474] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:35.550351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.560777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e8313-1f4b-4021-96b8-788cfaacc98c admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.566389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70aac0-75d7-4347-a33f-83d04c7989d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.567312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70aac0-75d7-4347-a33f-83d04c7989d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.567652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70aac0-75d7-4347-a33f-83d04c7989d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.567932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70aac0-75d7-4347-a33f-83d04c7989d9 admin admin] PATH_INFO: `/v3/projects/bbc85d2f47ed42ae9d13c15932375126/users/54abb874e0234293abd01646eaf0e5a0/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.584284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70aac0-75d7-4347-a33f-83d04c7989d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc85d2f47ed42ae9d13c15932375126, user_id=54abb874e0234293abd01646eaf0e5a0, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.587079 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70aac0-75d7-4347-a33f-83d04c7989d9 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.647762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9446eb50e194ce6b0f93a052b29ba0f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:35.648673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9446eb50e194ce6b0f93a052b29ba0f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:35.656419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9446eb50e194ce6b0f93a052b29ba0f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:35.663891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1230/2475] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:35 2022] PUT /identity/v3/projects/bbc85d2f47ed42ae9d13c15932375126/users/54abb874e0234293abd01646eaf0e5a0/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:35.669120 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.669412 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.669882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.671176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9446eb50e194ce6b0f93a052b29ba0f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:35.672152 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-59300f62-bfda-4345-9be0-ad34a788e8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9446eb50e194ce6b0f93a052b29ba0f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:35.692792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:35.694002 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:35.726655 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1246/2476] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:35 2022] DELETE /identity/v3/users/f9446eb50e194ce6b0f93a052b29ba0f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:35.731389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.731790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.732081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.750769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:35.751850 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:35.755045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1231/2477] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:35.764939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.766373 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:35.809447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1247/2478] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:35.819677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:35.821056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:35.829448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27451833-634b-4d24-b099-8cdece07f3ee None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.876391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.877043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.877367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.877598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de2b13-986a-4f96-9b1c-f9206a7be15e None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:35.877815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.881412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:35.882114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:35.882402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:35.882673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:35.886926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.888344 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.892418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:35.893958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:35.898040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1232/2479] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:35.903669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1248/2480] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:36.344323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:36.345888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:36.363887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfed998-0e72-41a2-ac61-a9c7c63ae9c1 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:36.370850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:36.372603 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:36.373414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:36.374447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] PATH_INFO: `/v3/projects/c36b74bedef34cee8c17e942436c3754` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:36.377204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36b74bedef34cee8c17e942436c3754)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:36.381842 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:36.517342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36b74bedef34cee8c17e942436c3754', 'request_id': 'req-152b76e6-8e50-4bec-8d2f-8721a32ec077'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.594494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:36.596002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:36.609544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dd1e-68e7-49ce-b002-8fa84656e920 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:36.640940 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36b74bedef34cee8c17e942436c3754', 'request_id': 'req-152b76e6-8e50-4bec-8d2f-8721a32ec077'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.648103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36b74bedef34cee8c17e942436c3754', 'request_id': 'req-152b76e6-8e50-4bec-8d2f-8721a32ec077'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.660323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] The token cache is being invalidate because project c36b74bedef34cee8c17e942436c3754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:36.667860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.668665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.670898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1233/2481] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:36 2022] DELETE /identity/v3/projects/c36b74bedef34cee8c17e942436c3754 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:36.674580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:36.675246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:36.676306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:36.676542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:36.676907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:36.677403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] PATH_INFO: `/v3/users/b2c1f951cc2543aa8aa658af9568636b` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:36.678881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c1f951cc2543aa8aa658af9568636b)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:36.681164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:36.691539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b76e6-8e50-4bec-8d2f-8721a32ec077 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:36.697539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:36.698942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:36.700370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:36.700370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] PATH_INFO: `/v3/users/b2b867df304540019590d03ce894c44e` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:36.703159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b867df304540019590d03ce894c44e)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:36.705746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:36.900737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b867df304540019590d03ce894c44e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.901758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b867df304540019590d03ce894c44e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.903155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c1f951cc2543aa8aa658af9568636b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.904119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c1f951cc2543aa8aa658af9568636b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.913181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c1f951cc2543aa8aa658af9568636b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.915983 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b867df304540019590d03ce894c44e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.916744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b867df304540019590d03ce894c44e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.928260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c1f951cc2543aa8aa658af9568636b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.928448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-e20e796f-23c9-4793-a23d-aa3ae9b3c6f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b867df304540019590d03ce894c44e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.932767 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c1f951cc2543aa8aa658af9568636b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:36.984060 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1234/2482] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:36 2022] DELETE /identity/v3/users/b2b867df304540019590d03ce894c44e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:37.036407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1249/2483] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:36 2022] DELETE /identity/v3/users/b2c1f951cc2543aa8aa658af9568636b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:37.041445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:37.042209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:37.042493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:37.060233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:37.061726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:37.128588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1235/2484] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:37.142788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:37.145268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:37.216494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455b61-ad55-4364-bf07-c1255104dc26 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:37.219884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:37.220933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:37.221478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:37.221969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:37.233256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:37.235526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:37.247701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1250/2485] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:22:37.443820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:37.445822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:37.466111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5808a-6ded-47a5-8fdd-fec191376380 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:37.471881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:37.473195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:37.473640 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:37.482876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] PATH_INFO: `/v3/projects/163a2607ca7649d8a7ac13e8d816db30` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:37.482876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163a2607ca7649d8a7ac13e8d816db30)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:37.482876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:37.624515 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163a2607ca7649d8a7ac13e8d816db30', 'request_id': 'req-811b227d-1bd1-4d11-9066-ac52b431ec58'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:37.679059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163a2607ca7649d8a7ac13e8d816db30', 'request_id': 'req-811b227d-1bd1-4d11-9066-ac52b431ec58'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:37.687380 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163a2607ca7649d8a7ac13e8d816db30', 'request_id': 'req-811b227d-1bd1-4d11-9066-ac52b431ec58'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:37.701050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] The token cache is being invalidate because project 163a2607ca7649d8a7ac13e8d816db30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:37.702080 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:37.702753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:37.704509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1236/2486] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:37 2022] DELETE /identity/v3/projects/163a2607ca7649d8a7ac13e8d816db30 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:37.708481 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:37.718907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b00003-0364-4ef2-960b-9c372fd753b5 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:37.796545 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:37.797927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:37.799123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:37.799410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] PATH_INFO: `/v3/users/418db6e3ee1a45b490f03bd931c8667c` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:37.800670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=418db6e3ee1a45b490f03bd931c8667c)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:37.802815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:37.899233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:37.901229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:37.923925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b227d-1bd1-4d11-9066-ac52b431ec58 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:37.930645 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:37.931606 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:37.932105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:37.932596 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] PATH_INFO: `/v3/projects/91e373f8f02f4244b6092ccaa53dc1eb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:37.934869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e373f8f02f4244b6092ccaa53dc1eb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:37.939244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:38.049646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418db6e3ee1a45b490f03bd931c8667c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.052812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418db6e3ee1a45b490f03bd931c8667c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.061918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418db6e3ee1a45b490f03bd931c8667c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.080925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418db6e3ee1a45b490f03bd931c8667c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.081686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-8dd6f4eb-5d30-4541-993d-2bb6baa8cffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418db6e3ee1a45b490f03bd931c8667c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.104070 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e373f8f02f4244b6092ccaa53dc1eb', 'request_id': 'req-3964ff15-b9e9-47c4-82da-0f0f894f6745'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.139552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1251/2487] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:37 2022] DELETE /identity/v3/users/418db6e3ee1a45b490f03bd931c8667c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:38.198557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e373f8f02f4244b6092ccaa53dc1eb', 'request_id': 'req-3964ff15-b9e9-47c4-82da-0f0f894f6745'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.207903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e373f8f02f4244b6092ccaa53dc1eb', 'request_id': 'req-3964ff15-b9e9-47c4-82da-0f0f894f6745'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.222706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] The token cache is being invalidate because project 91e373f8f02f4244b6092ccaa53dc1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:38.223114 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.223950 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3964ff15-b9e9-47c4-82da-0f0f894f6745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:38.237818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1237/2488] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:37 2022] DELETE /identity/v3/projects/91e373f8f02f4244b6092ccaa53dc1eb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:38.237945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369b64-6e2d-4ec0-b931-42579ec63f90 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.237945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369b64-6e2d-4ec0-b931-42579ec63f90 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.237945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369b64-6e2d-4ec0-b931-42579ec63f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.276640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-01369b64-6e2d-4ec0-b931-42579ec63f90 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:38.278703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-01369b64-6e2d-4ec0-b931-42579ec63f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:38.367948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1252/2489] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:38.385350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a9b1-c966-4f2e-82a9-363eebdc9daf None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.385350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a9b1-c966-4f2e-82a9-363eebdc9daf None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.386124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67a9b1-c966-4f2e-82a9-363eebdc9daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.407888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ee67a9b1-c966-4f2e-82a9-363eebdc9daf None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:38.409561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ee67a9b1-c966-4f2e-82a9-363eebdc9daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:38.419634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1238/2490] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:38.424272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369b64-6e2d-4ec0-b931-42579ec63f90 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:38.434604 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369b64-6e2d-4ec0-b931-42579ec63f90 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:38.439468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:38.440120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.440401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.440675 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.441432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:38.441739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:38.443411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:38.455901 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1253/2491] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:22:38.482651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a9b1-c966-4f2e-82a9-363eebdc9daf None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:38.492167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67a9b1-c966-4f2e-82a9-363eebdc9daf None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:38.497307 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:38.497957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.498236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.498537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.499212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:38.501095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:38.686376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1239/2492] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:38 2022] POST /identity/v3/projects => generated 391 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:38.688066 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:38.700488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1ff6f-c53f-4f09-b97d-9dad49ef0f5a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:38.765431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:38.766212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.766434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.766916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.767614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:38.769662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:38.858184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1254/2493] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:38 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:38.862569 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:38.876127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87524-d2be-47f0-b9e0-84af428ab834 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:38.882133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:38.882875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.883164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.883445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.884213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:38.885850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:38.900141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1240/2494] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:38.908202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:38.918843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed22ab4-c1a2-4893-83d2-2ddd3f12d667 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:38.924132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:38.924813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.925118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.925475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.926222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:38.927824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:38.939064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1255/2495] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:38.944475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:38.957730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d56f18-8fea-4f06-86c2-84f30a2d04a0 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:38.962132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:38.963226 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7b35-f8cc-4720-b5b3-d87e015c5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:38.964336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7b35-f8cc-4720-b5b3-d87e015c5b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:38.964678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7b35-f8cc-4720-b5b3-d87e015c5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:38.964956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7b35-f8cc-4720-b5b3-d87e015c5b35 admin admin] PATH_INFO: `/v3/projects/06214c6ed6834af1b3154c18dae0d73f/users/ffce1c200c43464699ef4f4c3b35d735/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:38.970173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:38.982514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7b35-f8cc-4720-b5b3-d87e015c5b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06214c6ed6834af1b3154c18dae0d73f, user_id=ffce1c200c43464699ef4f4c3b35d735, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:38.985448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7b35-f8cc-4720-b5b3-d87e015c5b35 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:38.996690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50c330-e90f-4970-9ae6-cf5202e6837f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.004411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.004411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.004411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.004411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] PATH_INFO: `/v3/projects/27a6a032a91748d0bb62b3fda17460e1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.004983 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a6a032a91748d0bb62b3fda17460e1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:39.006985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:39.087907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1241/2496] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:38 2022] PUT /identity/v3/projects/06214c6ed6834af1b3154c18dae0d73f/users/ffce1c200c43464699ef4f4c3b35d735/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:39.099588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.100099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.100624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.139987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a6a032a91748d0bb62b3fda17460e1', 'request_id': 'req-e57af0e1-7103-428b-888f-f8ee3ba5e412'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:39.153599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] MFA Rules not processed for user `ffce1c200c43464699ef4f4c3b35d735`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:39.154994 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:39.235373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a6a032a91748d0bb62b3fda17460e1', 'request_id': 'req-e57af0e1-7103-428b-888f-f8ee3ba5e412'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:39.245823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a6a032a91748d0bb62b3fda17460e1', 'request_id': 'req-e57af0e1-7103-428b-888f-f8ee3ba5e412'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:39.257144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1242/2497] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:39.265744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:39.271901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:39.272039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] The token cache is being invalidate because project 27a6a032a91748d0bb62b3fda17460e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:39.272039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:39.272682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e57af0e1-7103-428b-888f-f8ee3ba5e412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:39.274950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1256/2498] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:38 2022] DELETE /identity/v3/projects/27a6a032a91748d0bb62b3fda17460e1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:39.280010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d0b86-b759-413d-95ad-369397de717d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.282842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d0b86-b759-413d-95ad-369397de717d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.283365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d0b86-b759-413d-95ad-369397de717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.306956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-9e0d0b86-b759-413d-95ad-369397de717d None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:39.308590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-9e0d0b86-b759-413d-95ad-369397de717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:39.349435 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bc7a2-d3f5-4ac3-a1b1-3ac622384262 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.353667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf946-fedb-4ca9-8a1f-dce2f9899784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.354475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf946-fedb-4ca9-8a1f-dce2f9899784 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.354861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf946-fedb-4ca9-8a1f-dce2f9899784 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.355237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf946-fedb-4ca9-8a1f-dce2f9899784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.358651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3e7cf946-fedb-4ca9-8a1f-dce2f9899784 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:39.382282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf946-fedb-4ca9-8a1f-dce2f9899784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:39.384762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf946-fedb-4ca9-8a1f-dce2f9899784 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:39.400667 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1243/2499] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:39.406267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1257/2500] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:39.415690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5ae5-503f-4f1d-a8be-83dbd096bffc None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.416240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5ae5-503f-4f1d-a8be-83dbd096bffc None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.416669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc5ae5-503f-4f1d-a8be-83dbd096bffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.440157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-40fc5ae5-503f-4f1d-a8be-83dbd096bffc None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:39.441550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-40fc5ae5-503f-4f1d-a8be-83dbd096bffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:39.453563 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1244/2501] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:39.466002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d0b86-b759-413d-95ad-369397de717d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:39.482521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d0b86-b759-413d-95ad-369397de717d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.489815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.496916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.496916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.496916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.496916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:39.496916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:39.496916 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:39.511317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1258/2502] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:22:39.515862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5ae5-503f-4f1d-a8be-83dbd096bffc None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:39.526370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc5ae5-503f-4f1d-a8be-83dbd096bffc None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.534502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.535271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.535672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.536016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.536792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:39.539471 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:39.657765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1245/2503] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:39 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:39.661763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:39.680924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c57a63-8eb5-4491-9ac2-dafd5bbb0b8c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.755784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.756774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.757149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.757650 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.758616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:39.761115 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:39.877940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1259/2504] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:39 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:39.882279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:39.895509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45631f1-0b6a-4ad7-bd46-19cea866c205 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.900539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.901253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.901571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.901805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.902526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:39.911832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:39.926337 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1246/2505] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:39.927794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:39.938528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74649f-4039-4945-b703-500d6aa7e3bc admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.943322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e1a59-e9f8-428e-9d82-462c07dd67e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.943989 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e1a59-e9f8-428e-9d82-462c07dd67e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.944278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e1a59-e9f8-428e-9d82-462c07dd67e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.944558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e1a59-e9f8-428e-9d82-462c07dd67e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:39.945322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e1a59-e9f8-428e-9d82-462c07dd67e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:39.946985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e1a59-e9f8-428e-9d82-462c07dd67e7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:39.964046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1260/2506] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:39.966948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:39.977694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e42ae0-9aa5-4734-b3a9-525e9d8755d5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:39.982961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:39.984459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:39.984459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:39.984677 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] PATH_INFO: `/v3/projects/d373330688b54634b9a951ee0f4dcfe3/users/22a6a77693b14e4dba3194bf66244d2a/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:40.020204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d373330688b54634b9a951ee0f4dcfe3, user_id=22a6a77693b14e4dba3194bf66244d2a, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:40.022896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:40.106467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1247/2507] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:39 2022] PUT /identity/v3/projects/d373330688b54634b9a951ee0f4dcfe3/users/22a6a77693b14e4dba3194bf66244d2a/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:40.111980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e6bf-0aa2-4da7-a7a5-55c3ea5ab2cb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:40.112266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e6bf-0aa2-4da7-a7a5-55c3ea5ab2cb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:40.112542 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e6bf-0aa2-4da7-a7a5-55c3ea5ab2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:40.133166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-d0c9e6bf-0aa2-4da7-a7a5-55c3ea5ab2cb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:40.134384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d0c9e6bf-0aa2-4da7-a7a5-55c3ea5ab2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:40.236718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1261/2508] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:40.247555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:40.250164 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:40.323882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3bae7-e331-41e7-a16a-b84abbb44fb3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:40.329284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:40.330031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:40.330443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:40.330795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:40.345816 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:40.347595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:40.373595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1248/2509] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:41.797972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107932-4268-4747-9b59-435faeb6c56b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:41.798940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107932-4268-4747-9b59-435faeb6c56b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:41.799400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12107932-4268-4747-9b59-435faeb6c56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:41.834063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-12107932-4268-4747-9b59-435faeb6c56b None None] MFA Rules not processed for user `22a6a77693b14e4dba3194bf66244d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:41.835600 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-12107932-4268-4747-9b59-435faeb6c56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:41.926165 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1262/2510] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:41.935278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:41.937355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:42.051841 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca32c3-6f7f-43dc-b6e5-0c47f62e158c service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:42.056112 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:42.056981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:42.057319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:42.057597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:42.088417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:42.091346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:42.122861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1249/2511] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:42.852225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6acf-6c6a-4bef-8e9f-71808479e605 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:42.852702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6acf-6c6a-4bef-8e9f-71808479e605 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:42.852702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc6acf-6c6a-4bef-8e9f-71808479e605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:42.886463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a2dc6acf-6c6a-4bef-8e9f-71808479e605 None None] MFA Rules not processed for user `54abb874e0234293abd01646eaf0e5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:42.886463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a2dc6acf-6c6a-4bef-8e9f-71808479e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:42.974859 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1263/2512] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:42.978805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:42.981342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:42.995793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335cce2-bad9-4eae-9159-12554784ae10 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:43.012405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:43.013425 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:43.017772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:43.018182 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:43.019451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:43.022001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:43.104651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1250/2513] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:42 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:43.109636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc6acf-6c6a-4bef-8e9f-71808479e605 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:43.120463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc6acf-6c6a-4bef-8e9f-71808479e605 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:43.183943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:43.184616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:43.184924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:43.185233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:43.186642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:43.188587 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:43.320022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1264/2514] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:43 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:22:43.323689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:43.335705 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b44d4-72b2-4d83-a404-d6a0d5841fa2 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:43.340547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:43.341372 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:43.341838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:43.342519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:43.343325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:43.344928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:43.356065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1251/2515] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:43.360861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:43.371269 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a451a-12e3-46dd-b462-70b12d670da5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:43.376854 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:43.377903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:43.378266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:43.378617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] PATH_INFO: `/v3/projects/7e85c9eb2121480ea7d1ec086fdd2185/users/34c8769a593f4aed8d094c3419cdd07f/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:43.395733 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e85c9eb2121480ea7d1ec086fdd2185, user_id=34c8769a593f4aed8d094c3419cdd07f, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:43.398621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:43.464113 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1265/2516] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:43 2022] PUT /identity/v3/projects/7e85c9eb2121480ea7d1ec086fdd2185/users/34c8769a593f4aed8d094c3419cdd07f/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:43.468779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:43.478768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1297ce-0b6d-4f14-82f0-e4ddb12c018a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:43.540108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:43.540898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:43.541217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:43.541573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:43.543636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:43.545817 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:43.568551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1252/2517] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:22:43.569051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:43.579460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79bb95-035a-49fc-a0c7-c3e4e6c7e677 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:43.587199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:43.588344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:43.594021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:43.594021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] PATH_INFO: `/v3/projects/7e85c9eb2121480ea7d1ec086fdd2185/users/34c8769a593f4aed8d094c3419cdd07f/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:43.594021 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e85c9eb2121480ea7d1ec086fdd2185, user_id=34c8769a593f4aed8d094c3419cdd07f, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:43.594947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:43.615500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1266/2518] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:43 2022] PUT /identity/v3/projects/7e85c9eb2121480ea7d1ec086fdd2185/users/34c8769a593f4aed8d094c3419cdd07f/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:44.253977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:44.258177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:44.277854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f192e7-c63a-49b4-8b44-e1d18c02130f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:44.365869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:44.367033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:44.367328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:44.367678 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] PATH_INFO: `/v3/users/4ddc456cdbd94bb287154b961f7d376d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:44.368973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddc456cdbd94bb287154b961f7d376d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:44.370945 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:44.587208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddc456cdbd94bb287154b961f7d376d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:44.588033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddc456cdbd94bb287154b961f7d376d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:44.604578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddc456cdbd94bb287154b961f7d376d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:44.605503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddc456cdbd94bb287154b961f7d376d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:44.617317 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddc456cdbd94bb287154b961f7d376d'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:44.709761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1253/2519] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:44 2022] DELETE /identity/v3/users/4ddc456cdbd94bb287154b961f7d376d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:44.997220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:44.999979 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:45.022605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd866dc-f3c3-4790-91ed-f5960e182a48 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:45.095240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:45.096179 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:45.096463 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:45.096738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] PATH_INFO: `/v3/projects/bce9a2accde947c08b8cb64a1fc32311` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:45.098394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce9a2accde947c08b8cb64a1fc32311)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:45.101261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:45.235427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce9a2accde947c08b8cb64a1fc32311', 'request_id': 'req-af7f865b-98dc-4bc4-8bce-640916ed1ad3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.319664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce9a2accde947c08b8cb64a1fc32311', 'request_id': 'req-af7f865b-98dc-4bc4-8bce-640916ed1ad3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.325884 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce9a2accde947c08b8cb64a1fc32311', 'request_id': 'req-af7f865b-98dc-4bc4-8bce-640916ed1ad3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.337988 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] The token cache is being invalidate because project bce9a2accde947c08b8cb64a1fc32311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:45.338279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.338972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.340717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1267/2520] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:44 2022] DELETE /identity/v3/projects/bce9a2accde947c08b8cb64a1fc32311 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:45.346899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:45.363410 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc0fac-99fb-46cf-8234-a26f68727cca admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:45.446403 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:45.447623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:45.448115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:45.448826 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] PATH_INFO: `/v3/users/1571001e5d2a4f3982d805a52de7cdeb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:45.450489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1571001e5d2a4f3982d805a52de7cdeb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:45.453359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:45.667689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1571001e5d2a4f3982d805a52de7cdeb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.668651 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1571001e5d2a4f3982d805a52de7cdeb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.682904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1571001e5d2a4f3982d805a52de7cdeb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.686785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1571001e5d2a4f3982d805a52de7cdeb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.691481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-701345a7-cbc8-4ed1-9689-989c36d7cbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1571001e5d2a4f3982d805a52de7cdeb'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:45.756031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1254/2521] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:22:45 2022] DELETE /identity/v3/users/1571001e5d2a4f3982d805a52de7cdeb => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:46.024606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:46.026169 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:46.042986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f865b-98dc-4bc4-8bce-640916ed1ad3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:46.247370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:46.249281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:46.252182 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:46.252484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] PATH_INFO: `/v3/projects/226e87a9d4bd4db38983edfb10424fe0` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:46.255403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226e87a9d4bd4db38983edfb10424fe0)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:46.258953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:46.305758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee590-65fd-4d19-a256-559ed2458fee None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:46.305758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee590-65fd-4d19-a256-559ed2458fee None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:46.305758 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee590-65fd-4d19-a256-559ed2458fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:46.334398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6c8ee590-65fd-4d19-a256-559ed2458fee None None] MFA Rules not processed for user `22a6a77693b14e4dba3194bf66244d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:46.334398 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6c8ee590-65fd-4d19-a256-559ed2458fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:46.420034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1255/2522] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Feb 16 18:22:46.425007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226e87a9d4bd4db38983edfb10424fe0', 'request_id': 'req-169f26ca-9c80-4464-b599-7bb75c93ae42'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:46.481912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226e87a9d4bd4db38983edfb10424fe0', 'request_id': 'req-169f26ca-9c80-4464-b599-7bb75c93ae42'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:46.493155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226e87a9d4bd4db38983edfb10424fe0', 'request_id': 'req-169f26ca-9c80-4464-b599-7bb75c93ae42'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:46.531137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] The token cache is being invalidate because project 226e87a9d4bd4db38983edfb10424fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:22:46.543561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:46.543561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-169f26ca-9c80-4464-b599-7bb75c93ae42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:22:46.552898 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1268/2523] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:22:46 2022] DELETE /identity/v3/projects/226e87a9d4bd4db38983edfb10424fe0 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:22:46.556000 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703369-1b2d-4913-a9ba-934f0e2920bf None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:46.556294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703369-1b2d-4913-a9ba-934f0e2920bf None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:46.559320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6703369-1b2d-4913-a9ba-934f0e2920bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:46.584550 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b6703369-1b2d-4913-a9ba-934f0e2920bf None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:46.586469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b6703369-1b2d-4913-a9ba-934f0e2920bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:46.689417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1256/2524] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:46.698488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c65fd-e20f-4c5a-8528-3d611feb30b6 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:46.698780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c65fd-e20f-4c5a-8528-3d611feb30b6 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:46.699064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c65fd-e20f-4c5a-8528-3d611feb30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:46.724255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f37c65fd-e20f-4c5a-8528-3d611feb30b6 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:46.725544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f37c65fd-e20f-4c5a-8528-3d611feb30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:46.738221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1269/2525] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:46.742768 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703369-1b2d-4913-a9ba-934f0e2920bf None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:46.760303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6703369-1b2d-4913-a9ba-934f0e2920bf None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:46.769222 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:46.770217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:46.770976 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:46.771361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:46.772214 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:22:46.772607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:46.774368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:46.813046 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c65fd-e20f-4c5a-8528-3d611feb30b6 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:46.820572 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1257/2526] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:22:46.824305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c65fd-e20f-4c5a-8528-3d611feb30b6 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:46.832217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:46.832994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:46.833763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:46.833763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:46.834920 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:46.836695 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:46.955528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1270/2527] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:22:46 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:46.968044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:46.984662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e14572-4c9d-41fe-9731-a91cc9ca3643 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:47.108397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:47.109459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:47.109906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:47.110364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:47.111379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:47.113957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:47.271376 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1258/2528] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:22:46 2022] POST /identity/v3/users => generated 287 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:22:47.280056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:47.287010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9478a-ea4a-4444-9929-e7ddf0671b1c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:47.292039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:47.292858 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:47.293283 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:47.293663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:47.294489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:47.297140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:47.320348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1271/2529] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:47.324461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:47.337024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8ef51-eb77-440f-96b9-8527f39e2e25 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:47.343295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f8557-c98b-4599-ad3b-0b0289387ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:47.344341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8557-c98b-4599-ad3b-0b0289387ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:47.344583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8557-c98b-4599-ad3b-0b0289387ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:47.344861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8557-c98b-4599-ad3b-0b0289387ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:47.345671 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f8557-c98b-4599-ad3b-0b0289387ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:47.347370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f8557-c98b-4599-ad3b-0b0289387ed4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:47.368337 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1259/2530] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:22:47.372214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:47.389608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24605ef-b8ac-41b3-aac0-2ea32b5fb0b8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:47.394900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:47.396152 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:47.396533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:47.396908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] PATH_INFO: `/v3/projects/9d5b466cb8b240088d1c9bbc4b4699bb/users/715ece1913a044f28bc1320bafd34ca1/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:47.419449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5b466cb8b240088d1c9bbc4b4699bb, user_id=715ece1913a044f28bc1320bafd34ca1, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:47.423663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:47.540085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1272/2531] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:22:47 2022] PUT /identity/v3/projects/9d5b466cb8b240088d1c9bbc4b4699bb/users/715ece1913a044f28bc1320bafd34ca1/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:22:47.546250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996983f-8074-473c-91cf-07c4e340b422 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:47.546892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996983f-8074-473c-91cf-07c4e340b422 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:47.547100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996983f-8074-473c-91cf-07c4e340b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:47.596581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b996983f-8074-473c-91cf-07c4e340b422 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:47.599908 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b996983f-8074-473c-91cf-07c4e340b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:47.739513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1260/2532] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:47.750769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:47.753860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:47.837130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea304f2d-a95b-4280-8c60-071db087d6d3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:47.847272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:47.849135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:47.849755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:47.849755 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:47.862078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:47.864035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:47.876027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1273/2533] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:49.955497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f07c4-53b6-488d-b32c-43ea97d17cdf None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:49.956518 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f07c4-53b6-488d-b32c-43ea97d17cdf None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:49.957561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f07c4-53b6-488d-b32c-43ea97d17cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:50.006964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b45f07c4-53b6-488d-b32c-43ea97d17cdf None None] MFA Rules not processed for user `715ece1913a044f28bc1320bafd34ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:50.010544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b45f07c4-53b6-488d-b32c-43ea97d17cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:50.135537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1261/2534] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:50.146612 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:50.148217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:50.281536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5e048-43bc-400c-9406-e3b5803e2d9f service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:50.286196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:50.286987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:50.287322 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:50.292138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:50.314009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:50.329986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:50.345267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1274/2535] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:51.427377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617d8e-7c9b-4acc-9053-c0253c475ba3 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:51.427919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617d8e-7c9b-4acc-9053-c0253c475ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:51.427919 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617d8e-7c9b-4acc-9053-c0253c475ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:51.464411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8c617d8e-7c9b-4acc-9053-c0253c475ba3 None None] MFA Rules not processed for user `34c8769a593f4aed8d094c3419cdd07f`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:51.465965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8c617d8e-7c9b-4acc-9053-c0253c475ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:51.550657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1262/2536] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:22:51.559083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:22:51.566246 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:51.795783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82c63c-2974-4a09-b337-fe36fd9aaf75 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:22:51.801566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:22:51.802211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:51.802495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:51.802771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:51.804574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:51.870116 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:22:51.871749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:22:51.888395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1275/2537] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:22:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:22:52.317930 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078853-237e-4b15-b1a7-aa9cfdf2b6c2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:22:52.318526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078853-237e-4b15-b1a7-aa9cfdf2b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:22:52.319001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078853-237e-4b15-b1a7-aa9cfdf2b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:22:52.349787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-01078853-237e-4b15-b1a7-aa9cfdf2b6c2 None None] MFA Rules not processed for user `715ece1913a044f28bc1320bafd34ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:22:52.351272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-01078853-237e-4b15-b1a7-aa9cfdf2b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:22:52.359363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1263/2538] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:22:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:01.404845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:01.406405 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:01.425394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25619057-374a-4e90-81ee-bcc0b4e5c48e service nova] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:01.432756 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:01.434439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:01.434439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:01.434439 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] PATH_INFO: `/v3/users/ffce1c200c43464699ef4f4c3b35d735` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:01.436598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffce1c200c43464699ef4f4c3b35d735)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:01.438810 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:01.619640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffce1c200c43464699ef4f4c3b35d735'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:01.620282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffce1c200c43464699ef4f4c3b35d735'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:01.628063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffce1c200c43464699ef4f4c3b35d735'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:01.640566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffce1c200c43464699ef4f4c3b35d735'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:01.641293 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffce1c200c43464699ef4f4c3b35d735'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:01.709310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1276/2539] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:23:01 2022] DELETE /identity/v3/users/ffce1c200c43464699ef4f4c3b35d735 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:23:01.716195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:01.716195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:01.716195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:01.736300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:01.737679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:01.803668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1264/2540] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:23:01.813750 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:01.815734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:01.889161 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559aec7-d813-4132-8ec0-cb15118e75a7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:01.892819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fb9c0-eeb4-4b78-94ca-37ac3b69d8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:01.893501 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb9c0-eeb4-4b78-94ca-37ac3b69d8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:01.893791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb9c0-eeb4-4b78-94ca-37ac3b69d8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:01.894061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb9c0-eeb4-4b78-94ca-37ac3b69d8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:01.903018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fb9c0-eeb4-4b78-94ca-37ac3b69d8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:01.905205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fb9c0-eeb4-4b78-94ca-37ac3b69d8b8 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:01.914385 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1277/2541] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:23:02.366924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:02.368502 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:02.384178 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c9313-67be-4581-8c57-1339b057902a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:02.396082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:02.401419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:02.401419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:02.401419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] PATH_INFO: `/v3/projects/06214c6ed6834af1b3154c18dae0d73f` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:02.401419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=06214c6ed6834af1b3154c18dae0d73f)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:02.402511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:02.517428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06214c6ed6834af1b3154c18dae0d73f', 'request_id': 'req-816a0ca6-629a-47cb-a8ea-aac1086ab1be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:02.580308 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06214c6ed6834af1b3154c18dae0d73f', 'request_id': 'req-816a0ca6-629a-47cb-a8ea-aac1086ab1be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:02.586862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06214c6ed6834af1b3154c18dae0d73f', 'request_id': 'req-816a0ca6-629a-47cb-a8ea-aac1086ab1be'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:02.599105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] The token cache is being invalidate because project 06214c6ed6834af1b3154c18dae0d73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:23:02.599388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:02.600031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-816a0ca6-629a-47cb-a8ea-aac1086ab1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:23:02.601613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1265/2542] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:23:02 2022] DELETE /identity/v3/projects/06214c6ed6834af1b3154c18dae0d73f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:23:02.606775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f75d96-3b0d-49b4-b478-7a858fef39df None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:02.607305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f75d96-3b0d-49b4-b478-7a858fef39df None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:02.607555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f75d96-3b0d-49b4-b478-7a858fef39df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:02.630379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-29f75d96-3b0d-49b4-b478-7a858fef39df None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:02.631659 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-29f75d96-3b0d-49b4-b478-7a858fef39df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:02.697056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1278/2543] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:02.707650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d33f-951e-482d-bdb3-fa623b311b2f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:02.708154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d33f-951e-482d-bdb3-fa623b311b2f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:02.708505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d33f-951e-482d-bdb3-fa623b311b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:02.730005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-3af3d33f-951e-482d-bdb3-fa623b311b2f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:02.731213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3af3d33f-951e-482d-bdb3-fa623b311b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:02.739717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1266/2544] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:02.744124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f75d96-3b0d-49b4-b478-7a858fef39df None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:02.755119 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f75d96-3b0d-49b4-b478-7a858fef39df None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:02.759911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:02.760686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:02.761064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:02.761440 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:02.762255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:23:02.762633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:02.765497 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:02.777190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1279/2545] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:23:02.782385 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3d33f-951e-482d-bdb3-fa623b311b2f None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:02.791756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3d33f-951e-482d-bdb3-fa623b311b2f None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:02.797426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:02.798153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:02.801662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:02.801662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:02.801662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:02.801662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:02.920881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1267/2546] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:23:02 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:23:02.925201 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:02.934987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea142c-be38-4ff3-905e-cd875f82e202 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:02.994434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:02.996786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:02.996786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:02.996786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:02.996786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:02.998347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:03.104261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1280/2547] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:23:02 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:23:03.105938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:03.116921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cfbc3-3a24-44e7-80c2-6908f307d455 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:03.121727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:03.122491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:03.122895 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:03.123216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:03.124104 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:03.125931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:03.137204 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1268/2548] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:23:03.141648 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:03.151867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2450c-18d8-4efc-afdf-b8e140ec8be6 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:03.157653 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b2402-96a9-4dcf-acf9-31bab5faaf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:03.158316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b2402-96a9-4dcf-acf9-31bab5faaf07 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:03.162238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b2402-96a9-4dcf-acf9-31bab5faaf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:03.162238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b2402-96a9-4dcf-acf9-31bab5faaf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:03.162238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b2402-96a9-4dcf-acf9-31bab5faaf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:03.162238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b2402-96a9-4dcf-acf9-31bab5faaf07 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:03.171731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1281/2549] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:23:03.175820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:03.185856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943af06-6d14-404f-9a5a-b06f5a55b250 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:03.191581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:03.197789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:03.197789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:03.197789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] PATH_INFO: `/v3/projects/504750dba476418dbce439401f05472d/users/d098b0a3b0784d98acdbdacab20dbd75/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:03.210759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504750dba476418dbce439401f05472d, user_id=d098b0a3b0784d98acdbdacab20dbd75, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:03.213439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:03.285465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1269/2550] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:23:03 2022] PUT /identity/v3/projects/504750dba476418dbce439401f05472d/users/d098b0a3b0784d98acdbdacab20dbd75/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:23:03.290475 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d733cd-6333-43a6-9ebf-d46949c8390e None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:03.290772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d733cd-6333-43a6-9ebf-d46949c8390e None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:03.291062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d733cd-6333-43a6-9ebf-d46949c8390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:03.309522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-82d733cd-6333-43a6-9ebf-d46949c8390e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:03.310717 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-82d733cd-6333-43a6-9ebf-d46949c8390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:03.392608 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1282/2551] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:03.403967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:03.406891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:03.471647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9e19e-da3e-4cae-95fb-40b25c60c8b3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:03.476889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:03.477853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:03.478150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:03.478433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:03.489335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:03.490730 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:03.504971 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1270/2552] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:23:09.741869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f674e5-8bfa-4b78-b620-5431cf4e9017 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:09.743454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f674e5-8bfa-4b78-b620-5431cf4e9017 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:09.743959 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f674e5-8bfa-4b78-b620-5431cf4e9017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:09.787948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-86f674e5-8bfa-4b78-b620-5431cf4e9017 None None] MFA Rules not processed for user `d098b0a3b0784d98acdbdacab20dbd75`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:09.789321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-86f674e5-8bfa-4b78-b620-5431cf4e9017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:09.878550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1283/2553] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:09.882694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:09.897044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df2fcf-ce3a-46e2-b40c-6e965db22533 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:09.916262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:09.917938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:09.918404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:09.918856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:09.923427 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:09.927491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:10.103094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1271/2554] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:23:09 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:23:10.107877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f674e5-8bfa-4b78-b620-5431cf4e9017 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:10.119766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f674e5-8bfa-4b78-b620-5431cf4e9017 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:10.225520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:10.225520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:10.225520 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:10.225931 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:10.227566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:10.230480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:10.349709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1284/2555] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:23:10 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:23:10.354907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:10.372047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355a922-93f6-4f04-8519-9290e1a8b2ad admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:10.379751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:10.379751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:10.379751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:10.379751 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:10.380219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:10.381988 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:10.394099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1272/2556] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:23:10.398870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:10.411410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4e14c-7f88-4cca-ba8b-d01144d294c3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:10.416427 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:10.417505 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:10.417967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:10.418299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] PATH_INFO: `/v3/projects/a3e7a68839d94072bb3d7d32763e68e9/users/2f01461ac76c435f84c7e0a9648045a3/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:10.433622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e7a68839d94072bb3d7d32763e68e9, user_id=2f01461ac76c435f84c7e0a9648045a3, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:10.437016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:10.527198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1285/2557] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:23:10 2022] PUT /identity/v3/projects/a3e7a68839d94072bb3d7d32763e68e9/users/2f01461ac76c435f84c7e0a9648045a3/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:23:10.529345 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:10.541718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a8e3-27b5-4970-87e2-a3bdcccef73e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:10.608245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:10.608907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:10.609219 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:10.609494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:10.610201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:10.611765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:10.621371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1273/2558] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:23:10.626441 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:10.638137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08348161-0591-435b-aaaa-e6fca9cd783b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:10.643172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efca5c0-b3ac-434d-a13a-0a7c6d9cef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:10.644141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca5c0-b3ac-434d-a13a-0a7c6d9cef91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:10.644557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca5c0-b3ac-434d-a13a-0a7c6d9cef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:10.644838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca5c0-b3ac-434d-a13a-0a7c6d9cef91 admin admin] PATH_INFO: `/v3/projects/a3e7a68839d94072bb3d7d32763e68e9/users/2f01461ac76c435f84c7e0a9648045a3/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:10.647139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efca5c0-b3ac-434d-a13a-0a7c6d9cef91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e7a68839d94072bb3d7d32763e68e9, user_id=2f01461ac76c435f84c7e0a9648045a3, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:10.649862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efca5c0-b3ac-434d-a13a-0a7c6d9cef91 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:10.662794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1286/2559] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:23:10 2022] PUT /identity/v3/projects/a3e7a68839d94072bb3d7d32763e68e9/users/2f01461ac76c435f84c7e0a9648045a3/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:23:11.632141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:11.635092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:11.773280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d471020-1dcc-45de-9d04-3f9f6a2a712a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:11.852232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb146a6-efd3-453e-abde-58654c564203 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:11.852912 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb146a6-efd3-453e-abde-58654c564203 service placement] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:11.853334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb146a6-efd3-453e-abde-58654c564203 service placement] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:11.853788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb146a6-efd3-453e-abde-58654c564203 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:11.860090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3cb146a6-efd3-453e-abde-58654c564203 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:11.874746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb146a6-efd3-453e-abde-58654c564203 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:11.877359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb146a6-efd3-453e-abde-58654c564203 service placement] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:11.890616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1274/2560] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:23:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:23:13.085591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:13.086526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:13.086969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:13.116627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] MFA Rules not processed for user `715ece1913a044f28bc1320bafd34ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:13.118164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:13.194256 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1287/2561] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:18.050535 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee769-ff87-4308-9761-195c83d1fd1b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:18.051059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee769-ff87-4308-9761-195c83d1fd1b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:18.055030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edee769-ff87-4308-9761-195c83d1fd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:18.080551 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5edee769-ff87-4308-9761-195c83d1fd1b None None] MFA Rules not processed for user `2f01461ac76c435f84c7e0a9648045a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:18.081853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5edee769-ff87-4308-9761-195c83d1fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:18.187566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1275/2562] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:18.204371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:18.205948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:18.309225 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e83167-72f2-40e2-ae0c-48915ef0711b None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:18.319198 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:18.319869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:18.320244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:18.320524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:18.391345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:18.392910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:18.412658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1288/2563] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:23:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:23:18.726612 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732cbb-8d2d-4fba-b9ff-178ce5fa6701 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:18.733536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732cbb-8d2d-4fba-b9ff-178ce5fa6701 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:18.733536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26732cbb-8d2d-4fba-b9ff-178ce5fa6701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:18.816582 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-26732cbb-8d2d-4fba-b9ff-178ce5fa6701 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:18.818128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-26732cbb-8d2d-4fba-b9ff-178ce5fa6701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:18.900607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1276/2564] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:23:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:19.093052 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:19.094910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:19.228878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064a7f-a19f-456b-992c-11aaff630201 service glance] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:19.235006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de5d4d-0d12-4704-a249-75664124a56e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:19.235668 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5d4d-0d12-4704-a249-75664124a56e service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:19.235948 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5d4d-0d12-4704-a249-75664124a56e service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:19.236221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5d4d-0d12-4704-a249-75664124a56e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:19.244619 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de5d4d-0d12-4704-a249-75664124a56e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:19.246254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de5d4d-0d12-4704-a249-75664124a56e service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:19.255261 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1289/2565] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:23:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:23:20.858782 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbcf8-5858-44d3-af11-eecaac7515d0 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:20.859402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbcf8-5858-44d3-af11-eecaac7515d0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:20.859402 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbbcf8-5858-44d3-af11-eecaac7515d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:20.892092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-12bbbcf8-5858-44d3-af11-eecaac7515d0 None None] MFA Rules not processed for user `54abb874e0234293abd01646eaf0e5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:20.893652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-12bbbcf8-5858-44d3-af11-eecaac7515d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:21.033298 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1277/2566] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:33.867922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770e15-9ac1-4034-b0d6-ad9cf5b8d97f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:33.868479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770e15-9ac1-4034-b0d6-ad9cf5b8d97f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:33.868479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770e15-9ac1-4034-b0d6-ad9cf5b8d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:33.886045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-90770e15-9ac1-4034-b0d6-ad9cf5b8d97f None None] MFA Rules not processed for user `d098b0a3b0784d98acdbdacab20dbd75`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:33.887254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-90770e15-9ac1-4034-b0d6-ad9cf5b8d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:33.895166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1290/2567] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:23:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:37.561292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6a76-70f0-4fd9-aab8-177bcc74d2aa None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:37.561854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6a76-70f0-4fd9-aab8-177bcc74d2aa None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:37.562087 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6a76-70f0-4fd9-aab8-177bcc74d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:37.583257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-fdef6a76-70f0-4fd9-aab8-177bcc74d2aa None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:37.584902 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fdef6a76-70f0-4fd9-aab8-177bcc74d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:37.596009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1278/2568] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:23:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:37.610127 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770e15-9ac1-4034-b0d6-ad9cf5b8d97f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:37.624906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770e15-9ac1-4034-b0d6-ad9cf5b8d97f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:37.631630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:37.632462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:37.633054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:37.633212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:37.643176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:37.644821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:37.658780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1291/2569] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:23:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:23:49.002149 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a02e-2ca9-46fb-a611-e641fbbd4db7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:49.002684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a02e-2ca9-46fb-a611-e641fbbd4db7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:49.002684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a02e-2ca9-46fb-a611-e641fbbd4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:49.022478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-12c6a02e-2ca9-46fb-a611-e641fbbd4db7 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:49.023712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-12c6a02e-2ca9-46fb-a611-e641fbbd4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:49.037832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1279/2570] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:23:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:49.050536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:49.064606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0e99-2337-49d2-ae83-528eeb6c8b8c service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:49.072017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd1f01-1808-4b4a-be91-cc64cf06f5c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:49.072687 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd1f01-1808-4b4a-be91-cc64cf06f5c7 service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:49.072976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd1f01-1808-4b4a-be91-cc64cf06f5c7 service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:49.073359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd1f01-1808-4b4a-be91-cc64cf06f5c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:49.085314 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd1f01-1808-4b4a-be91-cc64cf06f5c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:49.087172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd1f01-1808-4b4a-be91-cc64cf06f5c7 service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:49.107658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1292/2571] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:23:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:23:51.385789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6a02e-2ca9-46fb-a611-e641fbbd4db7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:51.466068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6a02e-2ca9-46fb-a611-e641fbbd4db7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:51.471343 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc6ef7-84a1-4216-9b14-cd944c22d826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:51.472487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6ef7-84a1-4216-9b14-cd944c22d826 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:51.473035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6ef7-84a1-4216-9b14-cd944c22d826 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:51.473711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6ef7-84a1-4216-9b14-cd944c22d826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:51.475616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-45bc6ef7-84a1-4216-9b14-cd944c22d826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:51.571541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6ef7-84a1-4216-9b14-cd944c22d826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:51.573721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6ef7-84a1-4216-9b14-cd944c22d826 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:51.586907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1280/2572] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:23:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:23:54.811239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233079c-2b3c-4568-b879-0782bf63c4ca None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:54.812185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233079c-2b3c-4568-b879-0782bf63c4ca None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:54.812664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233079c-2b3c-4568-b879-0782bf63c4ca None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:54.815102 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1293/2573] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:23:54.821028 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997c7f9-f46f-4558-b1b5-4b143fae293e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:54.822340 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997c7f9-f46f-4558-b1b5-4b143fae293e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:54.822858 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997c7f9-f46f-4558-b1b5-4b143fae293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:54.934040 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-b997c7f9-f46f-4558-b1b5-4b143fae293e None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:23:54.938100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b997c7f9-f46f-4558-b1b5-4b143fae293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:55.056749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1281/2574] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:23:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:23:55.069148 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233079c-2b3c-4568-b879-0782bf63c4ca None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:23:55.071281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f233079c-2b3c-4568-b879-0782bf63c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:23:55.094316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233079c-2b3c-4568-b879-0782bf63c4ca None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:23:55.103287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:23:55.104167 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:23:55.104761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:23:55.105327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:23:55.126195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:23:55.128413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:23:55.147300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1294/2575] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:23:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:24:11.840828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b58ec3-b4f8-441a-a8ad-1aec05f86334 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:11.841879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b58ec3-b4f8-441a-a8ad-1aec05f86334 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:11.841879 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b58ec3-b4f8-441a-a8ad-1aec05f86334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:11.859856 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-82b58ec3-b4f8-441a-a8ad-1aec05f86334 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:24:11.861133 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-82b58ec3-b4f8-441a-a8ad-1aec05f86334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:11.868442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1282/2576] 10.222.0.87 () {58 vars in 967 bytes} [Wed Feb 16 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:24:11.882264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:11.894050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4940b-8709-405b-b00e-f79c7d0129db service nova] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:11.899013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:11.899643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:11.900005 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:11.900286 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:11.909790 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:11.911418 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:11.920205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1295/2577] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:24:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:24:17.006019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1f67-48e4-48f1-ac0a-9651fc0330be None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:17.006548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1f67-48e4-48f1-ac0a-9651fc0330be None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:17.006548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1f67-48e4-48f1-ac0a-9651fc0330be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:17.025788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c55d1f67-48e4-48f1-ac0a-9651fc0330be None None] MFA Rules not processed for user `22a6a77693b14e4dba3194bf66244d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:24:17.027063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c55d1f67-48e4-48f1-ac0a-9651fc0330be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:17.084893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1283/2578] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:24:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:24:18.246085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:18.248397 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:18.318013 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe38a1-6e1a-45ce-974b-e98003bd00e4 service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:18.322871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:18.323773 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:18.324062 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:18.324342 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] PATH_INFO: `/v3/users/715ece1913a044f28bc1320bafd34ca1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:18.325574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715ece1913a044f28bc1320bafd34ca1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:18.327933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:18.551709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715ece1913a044f28bc1320bafd34ca1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:18.552403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715ece1913a044f28bc1320bafd34ca1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:18.559575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715ece1913a044f28bc1320bafd34ca1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:18.571217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715ece1913a044f28bc1320bafd34ca1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:18.571866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715ece1913a044f28bc1320bafd34ca1'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:18.627241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1296/2579] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:24:18 2022] DELETE /identity/v3/users/715ece1913a044f28bc1320bafd34ca1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:24:18.877761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1f67-48e4-48f1-ac0a-9651fc0330be None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:18.887197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1f67-48e4-48f1-ac0a-9651fc0330be None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:18.954992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:18.955877 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:18.956284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:18.956585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] PATH_INFO: `/v3/projects/9d5b466cb8b240088d1c9bbc4b4699bb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:18.957888 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5b466cb8b240088d1c9bbc4b4699bb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:18.959786 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:19.055541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5b466cb8b240088d1c9bbc4b4699bb', 'request_id': 'req-9ebca5e7-de43-4282-8a53-b67c48af89c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:19.124913 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5b466cb8b240088d1c9bbc4b4699bb', 'request_id': 'req-9ebca5e7-de43-4282-8a53-b67c48af89c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:19.130969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5b466cb8b240088d1c9bbc4b4699bb', 'request_id': 'req-9ebca5e7-de43-4282-8a53-b67c48af89c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:19.142885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] The token cache is being invalidate because project 9d5b466cb8b240088d1c9bbc4b4699bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:24:19.143175 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:19.143854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:19.145429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1284/2580] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:24:18 2022] DELETE /identity/v3/projects/9d5b466cb8b240088d1c9bbc4b4699bb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:24:25.090068 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:25.091526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:25.150413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cdeda-6194-462c-b5cb-dc648d88d537 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:25.199960 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:25.200081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:25.200398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:25.200705 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:25.202812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:25.264823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:25.266357 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:25.275589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1297/2581] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:24:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:24:38.622274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:38.625634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:38.692379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebca5e7-de43-4282-8a53-b67c48af89c5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:38.697069 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:38.697981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:38.698267 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:38.698541 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] PATH_INFO: `/v3/users/aa5997154dac436286980abb7f34185a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:38.699722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5997154dac436286980abb7f34185a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:38.701738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:38.906474 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5997154dac436286980abb7f34185a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:38.907297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5997154dac436286980abb7f34185a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:38.918617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5997154dac436286980abb7f34185a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:38.919243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5997154dac436286980abb7f34185a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:38.927183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-39272ca4-43d1-4e2e-8ff4-177c475fe36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5997154dac436286980abb7f34185a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:39.012749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1285/2582] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:24:38 2022] DELETE /identity/v3/users/aa5997154dac436286980abb7f34185a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:24:39.366402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:39.378380 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162e53-5c33-4598-abc1-99426f12edff service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:39.434953 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:39.435814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:39.436098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:39.436404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] PATH_INFO: `/v3/projects/e740c52ad64142398b541359c4b59da4` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:39.437627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e740c52ad64142398b541359c4b59da4)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:39.440265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:39.554030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e740c52ad64142398b541359c4b59da4', 'request_id': 'req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:39.653118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e740c52ad64142398b541359c4b59da4', 'request_id': 'req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:39.659319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e740c52ad64142398b541359c4b59da4', 'request_id': 'req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:39.670902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] The token cache is being invalidate because project e740c52ad64142398b541359c4b59da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:24:39.671199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:39.672012 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fcc7dc02-426b-488e-a6ce-ba6d406c74b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:24:39.673778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1298/2583] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:24:39 2022] DELETE /identity/v3/projects/e740c52ad64142398b541359c4b59da4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:24:39.679673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c9e3-d4c5-4223-b165-4a5529e20f92 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:39.680186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c9e3-d4c5-4223-b165-4a5529e20f92 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:39.680375 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8c9e3-d4c5-4223-b165-4a5529e20f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:39.699228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e2d8c9e3-d4c5-4223-b165-4a5529e20f92 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:24:39.700436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e2d8c9e3-d4c5-4223-b165-4a5529e20f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:39.761217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1286/2584] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:24:39.769147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e109-510d-489a-b3dc-aa213ccfa4d1 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:39.769443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e109-510d-489a-b3dc-aa213ccfa4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:39.769719 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7e109-510d-489a-b3dc-aa213ccfa4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:39.787731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-89d7e109-510d-489a-b3dc-aa213ccfa4d1 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:24:39.788922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-89d7e109-510d-489a-b3dc-aa213ccfa4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:39.796832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1299/2585] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:24:39.801677 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c9e3-d4c5-4223-b165-4a5529e20f92 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:39.811314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8c9e3-d4c5-4223-b165-4a5529e20f92 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:39.816723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:39.817419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:39.817702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:39.820924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:39.820924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:24:39.820924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:39.820924 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:39.832629 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1287/2586] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:24:39.836878 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e109-510d-489a-b3dc-aa213ccfa4d1 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:39.845912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7e109-510d-489a-b3dc-aa213ccfa4d1 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:39.850696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:39.851344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:39.851620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:39.851900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:39.852583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:39.854638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:39.954808 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1300/2587] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:24:39 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:24:39.959077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:39.969423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdfc4f-bd67-4907-ab27-3e5eea3c9c2e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:40.034599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:40.035284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:40.035570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:40.035848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:40.036545 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:40.038504 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:40.130200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1288/2588] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:24:39 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:24:40.134308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:40.144820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561e913-feb1-4f89-9897-e9137a817637 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:40.149699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:40.150359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:40.150683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:40.151014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:40.151738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:40.153500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:40.164698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1301/2589] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:24:40.168814 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:40.179748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d1442-5d34-41c8-a38e-c0b5f80f476b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:40.184405 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb5d8-dd7d-4c52-adcd-67ee86fae4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:40.185097 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb5d8-dd7d-4c52-adcd-67ee86fae4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:40.185381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb5d8-dd7d-4c52-adcd-67ee86fae4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:40.185661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb5d8-dd7d-4c52-adcd-67ee86fae4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:40.186388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb5d8-dd7d-4c52-adcd-67ee86fae4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:40.187959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fb5d8-dd7d-4c52-adcd-67ee86fae4a8 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:40.198802 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1289/2590] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:24:40.203220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:40.213305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a060-f0b8-4d06-a857-f8c6dda7edb0 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:40.217999 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:40.218870 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:40.219155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:40.220028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] PATH_INFO: `/v3/projects/f578810a0a59485687a431fe9130087f/users/f2171ec4fc004821a9981919929ec56d/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:40.234696 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f578810a0a59485687a431fe9130087f, user_id=f2171ec4fc004821a9981919929ec56d, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:40.238016 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:40.305210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1302/2591] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:24:40 2022] PUT /identity/v3/projects/f578810a0a59485687a431fe9130087f/users/f2171ec4fc004821a9981919929ec56d/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:24:40.310424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45ff34-4a10-4fd9-82a8-bd0ef7469baf None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:40.310718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45ff34-4a10-4fd9-82a8-bd0ef7469baf None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:40.311001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45ff34-4a10-4fd9-82a8-bd0ef7469baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:40.329977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-af45ff34-4a10-4fd9-82a8-bd0ef7469baf None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:24:40.331294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-af45ff34-4a10-4fd9-82a8-bd0ef7469baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:40.389636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1290/2592] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:24:40.399143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:40.400898 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:40.456071 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5063a58-8c51-452a-8a64-895885a925fb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:40.459692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:40.460325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:40.460607 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:40.460881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:40.470450 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:40.471720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:40.480785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1303/2593] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:24:45.573289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eac4f-46f1-4429-a7c9-7e53bed52f49 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:45.573819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eac4f-46f1-4429-a7c9-7e53bed52f49 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:45.573819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eac4f-46f1-4429-a7c9-7e53bed52f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:45.617146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-883eac4f-46f1-4429-a7c9-7e53bed52f49 None None] MFA Rules not processed for user `f2171ec4fc004821a9981919929ec56d`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:24:45.617146 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-883eac4f-46f1-4429-a7c9-7e53bed52f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:45.709138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1291/2594] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:24:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:24:45.719250 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:24:45.721479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:45.803498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953190-faa0-46b5-be89-9abc0a62a128 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:24:45.810238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da05f5-c668-4c77-93d1-89dcb50ed1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:24:45.811433 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da05f5-c668-4c77-93d1-89dcb50ed1f4 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:45.811723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da05f5-c668-4c77-93d1-89dcb50ed1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:45.812004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da05f5-c668-4c77-93d1-89dcb50ed1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:45.822373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da05f5-c668-4c77-93d1-89dcb50ed1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:24:45.824022 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da05f5-c668-4c77-93d1-89dcb50ed1f4 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:24:45.834651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1304/2595] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:24:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:24:48.733536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:24:48.733536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:24:48.734131 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:24:48.776715 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] MFA Rules not processed for user `f2171ec4fc004821a9981919929ec56d`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:24:48.778356 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:24:48.787063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1292/2596] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:24:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:25:04.077111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bf47-ad24-4346-b405-65f19cf36ded None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:25:04.077938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bf47-ad24-4346-b405-65f19cf36ded None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:25:04.078044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50bf47-ad24-4346-b405-65f19cf36ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:25:04.095212 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2c50bf47-ad24-4346-b405-65f19cf36ded None None] MFA Rules not processed for user `9463920d27f94ad688f3850e88795c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:25:04.096449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2c50bf47-ad24-4346-b405-65f19cf36ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:25:04.162302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1305/2597] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:25:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:25:09.212900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:25:09.218748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:25:09.232140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185ab1-9e2a-4b3c-8b62-2640405b1f3b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:25:09.232867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:25:09.233561 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:25:09.233849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:25:09.234127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:25:09.235916 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:25:09.250857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:25:09.252282 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:25:09.265012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1293/2598] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:25:09.527288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50bf47-ad24-4346-b405-65f19cf36ded None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:25:09.537669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50bf47-ad24-4346-b405-65f19cf36ded None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:25:09.541846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:25:09.544938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:25:09.544938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:25:09.544938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:25:09.544938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:25:09.559725 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:25:09.561190 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:25:09.573669 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1306/2599] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:25:17.746770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:25:17.758668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284954-f6d7-4c12-a9fc-d798be7f6a98 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:25:17.764102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:25:17.764734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:25:17.765016 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:25:17.765326 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:25:17.767051 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:25:17.777590 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:25:17.779170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:25:17.788029 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1294/2600] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:25:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:25:26.303064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:25:26.304577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:25:26.319407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae5f3a-fe96-44e8-a4aa-7b7807443e4e service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:25:26.325513 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:25:26.326395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:25:26.326749 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:25:26.327094 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] PATH_INFO: `/v3/users/22a6a77693b14e4dba3194bf66244d2a` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:25:26.328550 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a6a77693b14e4dba3194bf66244d2a)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:25:26.330503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:25:26.490872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a6a77693b14e4dba3194bf66244d2a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:26.491511 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a6a77693b14e4dba3194bf66244d2a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:26.498886 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a6a77693b14e4dba3194bf66244d2a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:26.510189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a6a77693b14e4dba3194bf66244d2a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:26.510838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fde943a6-da70-4325-8f10-27055214a61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a6a77693b14e4dba3194bf66244d2a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:26.592334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1307/2601] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:25:26 2022] DELETE /identity/v3/users/22a6a77693b14e4dba3194bf66244d2a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:25:26.811494 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:25:26.822857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146fd-6030-43cb-91e8-91199b8b0207 service nova] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:25:26.878341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:25:26.879191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:25:26.879477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:25:26.879736 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] PATH_INFO: `/v3/projects/d373330688b54634b9a951ee0f4dcfe3` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:25:26.880892 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d373330688b54634b9a951ee0f4dcfe3)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:25:26.882957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:25:26.994868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd373330688b54634b9a951ee0f4dcfe3', 'request_id': 'req-4d0502f7-f730-4d22-a6c1-406168a045f7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:27.060457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd373330688b54634b9a951ee0f4dcfe3', 'request_id': 'req-4d0502f7-f730-4d22-a6c1-406168a045f7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:27.066501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd373330688b54634b9a951ee0f4dcfe3', 'request_id': 'req-4d0502f7-f730-4d22-a6c1-406168a045f7'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:27.078748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] The token cache is being invalidate because project d373330688b54634b9a951ee0f4dcfe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:25:27.079147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:27.079779 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:25:27.081324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1295/2602] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:25:26 2022] DELETE /identity/v3/projects/d373330688b54634b9a951ee0f4dcfe3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:26:08.558117 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:08.564008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:08.564008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:08.579672 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:08.580932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:08.638652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1308/2603] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:26:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:26:08.772467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:08.774003 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:08.841216 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0502f7-f730-4d22-a6c1-406168a045f7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:08.846192 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:08.846837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:08.847117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:08.847391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:08.855105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:08.857198 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:08.864797 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1296/2604] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:26:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:26:09.265030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:09.267254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:09.357386 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8511745-770f-4de3-9094-20db35dbf772 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:09.375253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:09.382742 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:09.383138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:09.383425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:09.389528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:09.416663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:09.419465 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:09.439936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1309/2605] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:26:11.615792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:11.619690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:11.697107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318185b-fef0-4333-b241-4cf057b67c6b service swift] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:11.697107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba6560-0cdf-4eff-84df-249d3399eb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:11.697107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6560-0cdf-4eff-84df-249d3399eb78 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:11.697107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6560-0cdf-4eff-84df-249d3399eb78 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:11.697999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba6560-0cdf-4eff-84df-249d3399eb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:11.702778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b5ba6560-0cdf-4eff-84df-249d3399eb78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:11.724828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba6560-0cdf-4eff-84df-249d3399eb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:11.728712 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba6560-0cdf-4eff-84df-249d3399eb78 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:11.750893 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1297/2606] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:26:13.967548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:13.969033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:14.038712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357293b-1765-4147-a69a-0beaebc054a8 service nova] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:14.043970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:14.044834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:14.045473 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:14.045912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:14.047912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:14.061240 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:14.064199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:14.082244 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1310/2607] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:26:18.280436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:18.280942 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:18.281041 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:18.306299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] MFA Rules not processed for user `54abb874e0234293abd01646eaf0e5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:18.307564 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:18.441188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1298/2608] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:26:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:26:18.884802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:18.896814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd9cf9-e324-41a6-88f1-c3b5bca5415b service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:18.900895 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:18.901683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:18.902033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:18.902296 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:18.904089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:18.914980 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:18.920510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:18.937238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1311/2609] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:26:19.729203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:19.730938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:19.743933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec301faa-2fb9-4fef-9da0-387b288a566d None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:19.748619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:19.749646 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:19.750170 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:19.750517 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:19.752446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:19.826261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:19.830005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:19.847057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:19.848963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:19.857305 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1299/2610] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:26:19.957266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab73669-5124-4414-bc1a-b6b76c456cee service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:19.963134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:19.964033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:19.964693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:19.965318 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:19.967432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:19.996348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:19.999008 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:20.011108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1312/2611] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:26:25.343672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:25.347037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:25.365297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de603472-285e-4244-a8a1-7524b35bbac9 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:25.373167 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:25.375275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:25.375275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:25.375275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] PATH_INFO: `/v3/users/9463920d27f94ad688f3850e88795c5b` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:25.377894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9463920d27f94ad688f3850e88795c5b)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:25.379931 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:25.610117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9463920d27f94ad688f3850e88795c5b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:25.611127 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9463920d27f94ad688f3850e88795c5b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:25.631393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9463920d27f94ad688f3850e88795c5b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:25.632294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9463920d27f94ad688f3850e88795c5b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:25.656211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a1dcd556-143d-401d-bd61-3625d7a39058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9463920d27f94ad688f3850e88795c5b'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:25.737125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1300/2612] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:26:25 2022] DELETE /identity/v3/users/9463920d27f94ad688f3850e88795c5b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:26:26.101325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:26.119969 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e508d-1814-4b48-a06c-df068eef0a5b service placement] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:26.202843 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:26.203962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.204472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.204745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] PATH_INFO: `/v3/projects/0aaf8bb86aa245d6a791ffe04f8a7cea` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.206961 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aaf8bb86aa245d6a791ffe04f8a7cea)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:26.208892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:26.330664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aaf8bb86aa245d6a791ffe04f8a7cea', 'request_id': 'req-42f6feff-3956-4b26-a8c3-5fd65a9d2576'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:26.397649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aaf8bb86aa245d6a791ffe04f8a7cea', 'request_id': 'req-42f6feff-3956-4b26-a8c3-5fd65a9d2576'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:26.404236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aaf8bb86aa245d6a791ffe04f8a7cea', 'request_id': 'req-42f6feff-3956-4b26-a8c3-5fd65a9d2576'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:26.415384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] The token cache is being invalidate because project 0aaf8bb86aa245d6a791ffe04f8a7cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:26:26.418847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:26.418847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-42f6feff-3956-4b26-a8c3-5fd65a9d2576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:26.418847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1313/2613] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:26:26 2022] DELETE /identity/v3/projects/0aaf8bb86aa245d6a791ffe04f8a7cea => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:26:26.423750 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37abac-b92d-4242-a20a-b8f5fc5f32d4 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.424301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37abac-b92d-4242-a20a-b8f5fc5f32d4 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.424301 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37abac-b92d-4242-a20a-b8f5fc5f32d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.447938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-ed37abac-b92d-4242-a20a-b8f5fc5f32d4 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:26.447938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-ed37abac-b92d-4242-a20a-b8f5fc5f32d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:26.504843 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1301/2614] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:26:26.513402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd62ab-01af-4973-9dff-653c9bceebce None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.513662 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd62ab-01af-4973-9dff-653c9bceebce None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.513944 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd62ab-01af-4973-9dff-653c9bceebce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.533925 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-c7dd62ab-01af-4973-9dff-653c9bceebce None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:26.535272 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c7dd62ab-01af-4973-9dff-653c9bceebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:26.544266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1314/2615] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:26:26.548297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37abac-b92d-4242-a20a-b8f5fc5f32d4 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:26.558537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37abac-b92d-4242-a20a-b8f5fc5f32d4 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:26.563562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:26.564229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.564518 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.564821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.565588 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:26:26.565899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:26.567492 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:26.579610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1302/2616] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:26:26.584206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd62ab-01af-4973-9dff-653c9bceebce None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:26.593956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd62ab-01af-4973-9dff-653c9bceebce None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:26.598795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:26.599461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.599751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.600029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.600736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:26.602714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:26.726320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1315/2617] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:26:26.730352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:26.740944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0073d92-8007-4ea1-9de5-fee91655d101 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:26.800921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:26.802599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.802599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.802599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.803072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:26.804968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:26.897350 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1303/2618] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:26:26 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:26:26.898665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:26.909776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1263c4-fcc7-4b6d-b660-fe8ea558ca4f admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:26.916420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c435b9-fec1-4d08-b1fe-757a62b780e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:26.917131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c435b9-fec1-4d08-b1fe-757a62b780e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.918002 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c435b9-fec1-4d08-b1fe-757a62b780e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.921371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c435b9-fec1-4d08-b1fe-757a62b780e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.922426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c435b9-fec1-4d08-b1fe-757a62b780e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:26.924248 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c435b9-fec1-4d08-b1fe-757a62b780e5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:26.939362 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1316/2619] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:26:26.941105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:26.952763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb27cf1-bad2-48bf-969d-6427ce052c8e admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:26.958382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:26.959191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.959484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.959762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.960290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.960542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:26.960758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.961050 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:26.962255 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:26.978404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1304/2620] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:26:26.978762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:26.984313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:26.985159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:26.990620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd61bc-0b19-4a8d-a7fc-b14f8581c82a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:26.996947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6300046-b5d9-468a-b6ed-116613acb567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:26.998177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300046-b5d9-468a-b6ed-116613acb567 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:26.998467 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300046-b5d9-468a-b6ed-116613acb567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:26.998747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6300046-b5d9-468a-b6ed-116613acb567 admin admin] PATH_INFO: `/v3/projects/76fd6f5de3984dad993f96e2d36ca878/users/547d0ca3ab244a0ebfbd5a06be32f0ef/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:27.019926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6300046-b5d9-468a-b6ed-116613acb567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fd6f5de3984dad993f96e2d36ca878, user_id=547d0ca3ab244a0ebfbd5a06be32f0ef, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:27.023046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6300046-b5d9-468a-b6ed-116613acb567 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:27.054970 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1317/2621] 10.222.0.87 () {58 vars in 967 bytes} [Wed Feb 16 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:26:27.068740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:27.070172 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:27.095743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1305/2622] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:26:26 2022] PUT /identity/v3/projects/76fd6f5de3984dad993f96e2d36ca878/users/547d0ca3ab244a0ebfbd5a06be32f0ef/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:26:27.100773 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:27.101067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:27.101369 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:27.120393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:27.122495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:27.148297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915dbf-a58b-4173-89ca-36e7494ee6cf None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:27.197329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1306/2623] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:26:27.207082 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:27.209012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:27.267731 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425e4ff-e49a-4329-86a9-c0c7e8ab35db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:27.269147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425e4ff-e49a-4329-86a9-c0c7e8ab35db service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:27.269513 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425e4ff-e49a-4329-86a9-c0c7e8ab35db service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:27.269861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425e4ff-e49a-4329-86a9-c0c7e8ab35db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:27.287200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfd2a6-ca74-4c68-be3a-442e72a43f0e None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:27.292154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b30b6-0435-4439-b094-c098e1daa1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:27.293053 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b30b6-0435-4439-b094-c098e1daa1cf service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:27.293414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b30b6-0435-4439-b094-c098e1daa1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:27.293687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b30b6-0435-4439-b094-c098e1daa1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:27.305059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b30b6-0435-4439-b094-c098e1daa1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:27.306813 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b30b6-0435-4439-b094-c098e1daa1cf service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:27.318390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1307/2624] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:26:27.336807 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425e4ff-e49a-4329-86a9-c0c7e8ab35db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:27.338443 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425e4ff-e49a-4329-86a9-c0c7e8ab35db service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:27.347897 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1318/2625] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:26:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:26:28.486823 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80cda-2a8a-49da-8b65-5932717844c6 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:28.487704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80cda-2a8a-49da-8b65-5932717844c6 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:28.488314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f80cda-2a8a-49da-8b65-5932717844c6 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:28.491453 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1308/2626] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:26:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:26:28.498347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f009651-0a80-4d5c-a0d7-e361a6671a22 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:28.498891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f009651-0a80-4d5c-a0d7-e361a6671a22 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:28.499107 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f009651-0a80-4d5c-a0d7-e361a6671a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:28.517560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6f009651-0a80-4d5c-a0d7-e361a6671a22 None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:28.518922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6f009651-0a80-4d5c-a0d7-e361a6671a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:28.594306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1319/2627] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:26:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:26:28.608859 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80cda-2a8a-49da-8b65-5932717844c6 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:28.611682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-96f80cda-2a8a-49da-8b65-5932717844c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:28.672309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f80cda-2a8a-49da-8b65-5932717844c6 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:28.676508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa689067-5ed1-480c-b7d6-66099a9f3caf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:28.677190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689067-5ed1-480c-b7d6-66099a9f3caf service glance] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:28.677476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689067-5ed1-480c-b7d6-66099a9f3caf service glance] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:28.677752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689067-5ed1-480c-b7d6-66099a9f3caf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:28.688291 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689067-5ed1-480c-b7d6-66099a9f3caf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:28.690124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689067-5ed1-480c-b7d6-66099a9f3caf service glance] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:28.701799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1309/2628] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:26:28.891552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a29456-a87b-4ff5-9b25-7e2bf86d8c71 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:28.892203 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a29456-a87b-4ff5-9b25-7e2bf86d8c71 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:28.892676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a29456-a87b-4ff5-9b25-7e2bf86d8c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:28.919840 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277a4a-cc05-484f-bd5f-f6c23f06d077 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:28.920284 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277a4a-cc05-484f-bd5f-f6c23f06d077 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:28.920701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277a4a-cc05-484f-bd5f-f6c23f06d077 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:28.924377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1310/2629] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:26:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:26:28.931666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd38da-34ca-4c57-8316-6e47da799dbf None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:28.932604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd38da-34ca-4c57-8316-6e47da799dbf None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:28.933455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd38da-34ca-4c57-8316-6e47da799dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:28.934466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-94a29456-a87b-4ff5-9b25-7e2bf86d8c71 None None] MFA Rules not processed for user `547d0ca3ab244a0ebfbd5a06be32f0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:28.936640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-94a29456-a87b-4ff5-9b25-7e2bf86d8c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:28.957616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-fcfd38da-34ca-4c57-8316-6e47da799dbf None None] MFA Rules not processed for user `9b842d30b55c48bf8f375bdcc829bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:28.959077 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-fcfd38da-34ca-4c57-8316-6e47da799dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:28.969885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1311/2630] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:26:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:26:28.985746 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd38da-34ca-4c57-8316-6e47da799dbf None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:28.995100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd38da-34ca-4c57-8316-6e47da799dbf None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:29.000130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:29.001429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:29.001795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:29.002147 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:29.010689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:29.012752 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:29.025503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1320/2631] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:26:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:26:29.036597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca0dca-43f3-4e36-8bcb-cd73f3f41417 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:29.036887 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca0dca-43f3-4e36-8bcb-cd73f3f41417 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:29.037312 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca0dca-43f3-4e36-8bcb-cd73f3f41417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:29.037869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1312/2632] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:26:29.060098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-bbca0dca-43f3-4e36-8bcb-cd73f3f41417 None None] MFA Rules not processed for user `547d0ca3ab244a0ebfbd5a06be32f0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:29.063181 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bbca0dca-43f3-4e36-8bcb-cd73f3f41417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:29.070634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1321/2633] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:26:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:26:29.082534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:29.083901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:29.100718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c145e1-2833-4c7a-90d3-4076d19e92af service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:29.106446 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:29.107094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:29.107377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:29.107652 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:29.128909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7a49-7bbe-49cd-8557-f282fa397c10 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:29.129253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7a49-7bbe-49cd-8557-f282fa397c10 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:29.129564 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c7a49-7bbe-49cd-8557-f282fa397c10 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:29.129709 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:29.131547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1322/2634] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:26:29.131686 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:29.138166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e59cf4-2b94-4c8e-bde5-b97c01fe7dfc None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:29.138387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e59cf4-2b94-4c8e-bde5-b97c01fe7dfc None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:29.138676 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e59cf4-2b94-4c8e-bde5-b97c01fe7dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:29.142116 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1313/2635] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:26:29.158867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-53e59cf4-2b94-4c8e-bde5-b97c01fe7dfc None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:29.160083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-53e59cf4-2b94-4c8e-bde5-b97c01fe7dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:29.173872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1323/2636] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:26:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:26:29.185169 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:29.200831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366089cd-160c-4f62-8aa2-6ee581fb8e00 service nova] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:29.205134 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:29.206033 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:29.206263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:29.206593 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:29.218831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:29.220365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:29.232139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1314/2637] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:26:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:26:34.310568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:34.311130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:34.311130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:34.329702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:34.330930 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:34.338739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1324/2638] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:26:34.353501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:34.369679 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2284-2c65-4cfd-bef3-ae2e3bfc715b service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:34.378212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:34.379457 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:34.380024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:34.380566 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:34.392381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:34.393836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:34.404008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1315/2639] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:26:38.969323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:38.970863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:38.986033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ee203-3373-4ba3-b0ba-eee045dd0698 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:38.990582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:38.991448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:38.991730 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:38.992028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] PATH_INFO: `/v3/users/d098b0a3b0784d98acdbdacab20dbd75` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:38.993281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d098b0a3b0784d98acdbdacab20dbd75)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:38.995204 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:39.197170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd098b0a3b0784d98acdbdacab20dbd75'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.198162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd098b0a3b0784d98acdbdacab20dbd75'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.206943 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd098b0a3b0784d98acdbdacab20dbd75'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.220713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd098b0a3b0784d98acdbdacab20dbd75'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.221429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd098b0a3b0784d98acdbdacab20dbd75'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.296796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1325/2640] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:26:38 2022] DELETE /identity/v3/users/d098b0a3b0784d98acdbdacab20dbd75 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:26:39.663867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:39.678201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a64b2-a2ea-47ef-87f6-0dfe488d6d29 service swift] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:39.739456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:39.740180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:39.740462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:39.740737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] PATH_INFO: `/v3/projects/504750dba476418dbce439401f05472d` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:39.742068 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504750dba476418dbce439401f05472d)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:39.744103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:39.858400 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504750dba476418dbce439401f05472d', 'request_id': 'req-3d2aa558-6517-4086-942c-69bdd13e4a93'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.936012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504750dba476418dbce439401f05472d', 'request_id': 'req-3d2aa558-6517-4086-942c-69bdd13e4a93'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.946009 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504750dba476418dbce439401f05472d', 'request_id': 'req-3d2aa558-6517-4086-942c-69bdd13e4a93'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.958583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] The token cache is being invalidate because project 504750dba476418dbce439401f05472d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:26:39.958863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.959513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:39.961021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1316/2641] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:26:39 2022] DELETE /identity/v3/projects/504750dba476418dbce439401f05472d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:26:39.965014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:39.966454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:39.979906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c002fad-b06a-414f-9bd9-f36f8348bbac admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:40.047430 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:40.048594 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:40.048971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:40.049348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] PATH_INFO: `/v3/users/2f01461ac76c435f84c7e0a9648045a3` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:40.050665 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f01461ac76c435f84c7e0a9648045a3)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:40.052679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:40.244189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f01461ac76c435f84c7e0a9648045a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:40.244889 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f01461ac76c435f84c7e0a9648045a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:40.253129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f01461ac76c435f84c7e0a9648045a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:40.266101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f01461ac76c435f84c7e0a9648045a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:40.267080 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-aa68e5b2-9eeb-4065-a3bc-a30941065a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f01461ac76c435f84c7e0a9648045a3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:40.627526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1326/2642] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:26:39 2022] DELETE /identity/v3/users/2f01461ac76c435f84c7e0a9648045a3 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:26:40.976362 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:40.977934 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:40.990887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2aa558-6517-4086-942c-69bdd13e4a93 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:41.079495 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:41.086329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:41.086329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:41.086329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] PATH_INFO: `/v3/projects/a3e7a68839d94072bb3d7d32763e68e9` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:41.086329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e7a68839d94072bb3d7d32763e68e9)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:41.086329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:41.233706 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e7a68839d94072bb3d7d32763e68e9', 'request_id': 'req-bb9447ce-6bde-48e4-989c-8592c1612143'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:41.313665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e7a68839d94072bb3d7d32763e68e9', 'request_id': 'req-bb9447ce-6bde-48e4-989c-8592c1612143'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:41.321195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e7a68839d94072bb3d7d32763e68e9', 'request_id': 'req-bb9447ce-6bde-48e4-989c-8592c1612143'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:41.333611 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] The token cache is being invalidate because project a3e7a68839d94072bb3d7d32763e68e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:26:41.333899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:41.334690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:26:41.337152 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1317/2643] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:26:40 2022] DELETE /identity/v3/projects/a3e7a68839d94072bb3d7d32763e68e9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:26:57.195059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5e0d0-cd75-42bf-a08c-d5078e385c11 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:57.195583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5e0d0-cd75-42bf-a08c-d5078e385c11 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:57.195583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5e0d0-cd75-42bf-a08c-d5078e385c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:57.215118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-68e5e0d0-cd75-42bf-a08c-d5078e385c11 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:26:57.216319 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-68e5e0d0-cd75-42bf-a08c-d5078e385c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:57.270085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1327/2644] 10.222.0.87 () {58 vars in 967 bytes} [Wed Feb 16 18:26:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:26:57.283713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:26:57.285363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:26:57.363932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9447ce-6bde-48e4-989c-8592c1612143 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:26:57.369230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c4a58-f37e-4553-b60f-92ec7b197103 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:26:57.369885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4a58-f37e-4553-b60f-92ec7b197103 service swift] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:26:57.370863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4a58-f37e-4553-b60f-92ec7b197103 service swift] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:26:57.371763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c4a58-f37e-4553-b60f-92ec7b197103 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:26:57.380217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c4a58-f37e-4553-b60f-92ec7b197103 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:26:57.381841 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c4a58-f37e-4553-b60f-92ec7b197103 service swift] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:26:57.390938 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1318/2645] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:26:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:27:01.409310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:27:01.409872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:27:01.409985 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:27:01.428629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] MFA Rules not processed for user `547d0ca3ab244a0ebfbd5a06be32f0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:27:01.429872 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:27:01.484540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1328/2646] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:27:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:27:16.434081 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68835a1f-cf35-41a7-b963-1edcf718896d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:27:16.434673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68835a1f-cf35-41a7-b963-1edcf718896d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:27:16.434673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68835a1f-cf35-41a7-b963-1edcf718896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:27:16.451696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-68835a1f-cf35-41a7-b963-1edcf718896d None None] MFA Rules not processed for user `547d0ca3ab244a0ebfbd5a06be32f0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:27:16.453567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-68835a1f-cf35-41a7-b963-1edcf718896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:27:16.460853 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1319/2647] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:27:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:27:16.709951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:27:16.711346 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:27:16.769305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5bf0-6a8a-4b3e-bd01-726558b9d726 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:27:16.772911 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828e874-590c-4237-8e18-0693fef0a4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:27:16.773580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e874-590c-4237-8e18-0693fef0a4db service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:27:16.773866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e874-590c-4237-8e18-0693fef0a4db service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:27:16.774142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e874-590c-4237-8e18-0693fef0a4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:27:16.775919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b828e874-590c-4237-8e18-0693fef0a4db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:27:16.785278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e874-590c-4237-8e18-0693fef0a4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:27:16.789526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e874-590c-4237-8e18-0693fef0a4db service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:27:16.794638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1329/2648] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:27:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:27:42.251488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:27:42.252056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:27:42.252056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:27:42.271511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] MFA Rules not processed for user `547d0ca3ab244a0ebfbd5a06be32f0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:27:42.272808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:27:42.279767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1320/2649] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:27:54.485842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:27:54.489882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:27:54.489882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:27:54.511112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] MFA Rules not processed for user `f2171ec4fc004821a9981919929ec56d`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:27:54.513454 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:27:54.580131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1330/2650] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:27:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:13.383767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:13.385835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:13.480489 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a428fb7-55c5-4038-825c-6f2ae4cb53b9 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:13.485793 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:13.486472 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:13.486759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:13.487039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:13.489461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:13.506548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:13.508157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:13.520309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1321/2651] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:29.181264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:29.182814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:29.248732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae1f77-2dff-4038-9b4d-9ac566032f74 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:29.253382 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:29.260000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:29.260000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:29.260000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] PATH_INFO: `/v3/users/547d0ca3ab244a0ebfbd5a06be32f0ef` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:29.260000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547d0ca3ab244a0ebfbd5a06be32f0ef)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:29.260000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:29.461180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547d0ca3ab244a0ebfbd5a06be32f0ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:29.461800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547d0ca3ab244a0ebfbd5a06be32f0ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:29.468307 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547d0ca3ab244a0ebfbd5a06be32f0ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:29.480193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547d0ca3ab244a0ebfbd5a06be32f0ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:29.480949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-168ed01d-3f05-45c8-86a5-964557273227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547d0ca3ab244a0ebfbd5a06be32f0ef'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:29.561938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1331/2652] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:28:29 2022] DELETE /identity/v3/users/547d0ca3ab244a0ebfbd5a06be32f0ef => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:29.814921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:29.828206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030f047-49d7-4be7-b6e8-211e214c060a service placement] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:29.885415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:29.886270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:29.886571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:29.886824 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] PATH_INFO: `/v3/projects/76fd6f5de3984dad993f96e2d36ca878` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:29.887980 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fd6f5de3984dad993f96e2d36ca878)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:29.889891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:29.991488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fd6f5de3984dad993f96e2d36ca878', 'request_id': 'req-37f20aa4-780d-4f44-a8d6-2846c2c5781a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:30.047597 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fd6f5de3984dad993f96e2d36ca878', 'request_id': 'req-37f20aa4-780d-4f44-a8d6-2846c2c5781a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:30.053426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fd6f5de3984dad993f96e2d36ca878', 'request_id': 'req-37f20aa4-780d-4f44-a8d6-2846c2c5781a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:30.064157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] The token cache is being invalidate because project 76fd6f5de3984dad993f96e2d36ca878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:28:30.064442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:30.065057 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-37f20aa4-780d-4f44-a8d6-2846c2c5781a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:30.066604 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1322/2653] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:28:29 2022] DELETE /identity/v3/projects/76fd6f5de3984dad993f96e2d36ca878 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:30.072141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549168a-6e1b-41c0-8465-6b38176cc4e5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.074671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549168a-6e1b-41c0-8465-6b38176cc4e5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.074671 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549168a-6e1b-41c0-8465-6b38176cc4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.091349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-4549168a-6e1b-41c0-8465-6b38176cc4e5 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:30.092553 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4549168a-6e1b-41c0-8465-6b38176cc4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:30.153907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1332/2654] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:30.161694 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3b32-270c-4c9c-ab2a-f5821dfe1da2 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.161985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3b32-270c-4c9c-ab2a-f5821dfe1da2 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.162265 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3b32-270c-4c9c-ab2a-f5821dfe1da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.180696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5ffd3b32-270c-4c9c-ab2a-f5821dfe1da2 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:30.181932 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5ffd3b32-270c-4c9c-ab2a-f5821dfe1da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:30.189769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1323/2655] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:30.194765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549168a-6e1b-41c0-8465-6b38176cc4e5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.204420 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549168a-6e1b-41c0-8465-6b38176cc4e5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:30.210078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:30.210736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.211026 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.211305 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.212023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:28:30.212332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:30.213986 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:30.226832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1333/2656] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:28:30.231157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3b32-270c-4c9c-ab2a-f5821dfe1da2 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.241107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3b32-270c-4c9c-ab2a-f5821dfe1da2 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:30.245825 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:30.246477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.246764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.247039 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.247724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:30.249635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:30.328941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1324/2657] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:28:30 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:30.333401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.343483 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625d62f-990f-4d38-99ea-c811adcc1992 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:30.398467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:30.399131 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.399414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.399689 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.400365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:30.402331 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:30.470728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1334/2658] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:28:30 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:30.475084 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.485765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92e766-8845-4bb3-982e-b0295668cf47 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:30.491789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:30.492458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.492748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.493026 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.493839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:30.495417 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:30.506336 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1325/2659] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:30.510313 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.520354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5921e-0e84-4d84-b584-cc539e8898c7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:30.524966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53ae5b-8434-4ad5-bbbc-98b5f3eee103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:30.525649 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ae5b-8434-4ad5-bbbc-98b5f3eee103 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.525933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ae5b-8434-4ad5-bbbc-98b5f3eee103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.526214 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ae5b-8434-4ad5-bbbc-98b5f3eee103 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.526932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53ae5b-8434-4ad5-bbbc-98b5f3eee103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:30.528516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53ae5b-8434-4ad5-bbbc-98b5f3eee103 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:30.538732 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1335/2660] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:30.542777 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.553610 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e69a2-3c0e-4dd5-a591-d0c04f8f36bd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:30.558278 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:30.559228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.559508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.559785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] PATH_INFO: `/v3/projects/f1194f0102d24a2085f776133058e992/users/ef4d1c0f8933476fb0d82fca60cb2499/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.574428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1194f0102d24a2085f776133058e992, user_id=ef4d1c0f8933476fb0d82fca60cb2499, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:30.577047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:30.665391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1326/2661] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:30 2022] PUT /identity/v3/projects/f1194f0102d24a2085f776133058e992/users/ef4d1c0f8933476fb0d82fca60cb2499/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:30.676089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b19a1-7cb4-4c67-9614-c238e70041f5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.676403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b19a1-7cb4-4c67-9614-c238e70041f5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.676686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b19a1-7cb4-4c67-9614-c238e70041f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.702544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ad2b19a1-7cb4-4c67-9614-c238e70041f5 None None] MFA Rules not processed for user `ef4d1c0f8933476fb0d82fca60cb2499`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:30.703758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ad2b19a1-7cb4-4c67-9614-c238e70041f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:30.768413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1336/2662] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:30.773501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.834579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ce428-68ba-443d-8cdc-086f9b608a78 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:30.839357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:30.840019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:30.840304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:30.840581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:30.841323 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:30.843218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:30.947554 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1327/2663] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:28:30 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:30.951627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b19a1-7cb4-4c67-9614-c238e70041f5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:30.963070 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b19a1-7cb4-4c67-9614-c238e70041f5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:31.018575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:31.019242 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.019531 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.019812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.020885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:31.022909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:31.127934 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1337/2664] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:28:30 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:31.132031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:31.142092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4f121-6e8b-4acf-8138-c42564a03ed3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:31.148687 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:31.149487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.149770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.150066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.150788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:31.152365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:31.163659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1328/2665] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:31.167958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:31.178323 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd2af7-7413-4649-8a96-5fe4f2b668b7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:31.182940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:31.183879 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.184160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.184431 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] PATH_INFO: `/v3/projects/df5c7ebbaf0441a7a6201f9eb56b795f/users/cca283a81dd745f79df28f08c096863a/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.199231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5c7ebbaf0441a7a6201f9eb56b795f, user_id=cca283a81dd745f79df28f08c096863a, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:31.201778 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:31.299664 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1338/2666] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:31 2022] PUT /identity/v3/projects/df5c7ebbaf0441a7a6201f9eb56b795f/users/cca283a81dd745f79df28f08c096863a/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:31.304585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:31.315461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9613e-0a07-4410-b3f3-954e3b0b5f75 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:31.370293 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0154ba0-b6e7-4c73-bd49-c7b0bda9106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:31.370962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0154ba0-b6e7-4c73-bd49-c7b0bda9106e admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.371245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0154ba0-b6e7-4c73-bd49-c7b0bda9106e admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.371524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0154ba0-b6e7-4c73-bd49-c7b0bda9106e admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.372283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0154ba0-b6e7-4c73-bd49-c7b0bda9106e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:31.373901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0154ba0-b6e7-4c73-bd49-c7b0bda9106e admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:31.383836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1329/2667] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:31.388692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:31.398740 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96064b5-2a13-4f00-bab3-7343136953df admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:31.403328 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:31.404197 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.404479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.404751 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] PATH_INFO: `/v3/projects/df5c7ebbaf0441a7a6201f9eb56b795f/users/cca283a81dd745f79df28f08c096863a/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.406764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5c7ebbaf0441a7a6201f9eb56b795f, user_id=cca283a81dd745f79df28f08c096863a, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:31.409517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:31.420195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1339/2668] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:31 2022] PUT /identity/v3/projects/df5c7ebbaf0441a7a6201f9eb56b795f/users/cca283a81dd745f79df28f08c096863a/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:31.430092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5860e-1ebc-4334-8588-bc0e1463e764 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.430389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5860e-1ebc-4334-8588-bc0e1463e764 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.430674 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5860e-1ebc-4334-8588-bc0e1463e764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.456227 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-39a5860e-1ebc-4334-8588-bc0e1463e764 None None] MFA Rules not processed for user `cca283a81dd745f79df28f08c096863a`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:31.457399 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-39a5860e-1ebc-4334-8588-bc0e1463e764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:31.522925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1330/2669] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:31.532962 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:31.534912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:31.591222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bccf6e-0f56-440d-8ba0-656a30c70c61 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:31.594866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:31.595502 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.595784 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.596059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.606073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:31.607499 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:31.617132 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1340/2670] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:31.820038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5860e-1ebc-4334-8588-bc0e1463e764 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:31.829543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5860e-1ebc-4334-8588-bc0e1463e764 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:31.833775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:31.834415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:31.834699 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:31.835269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:31.890552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:31.891978 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:31.901043 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1331/2671] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:38.908877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:38.917480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243da4b-a466-48b0-aeca-5c3c264f0353 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:38.921073 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b6d75-55b4-470a-828f-51d04f2808b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:38.921727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6d75-55b4-470a-828f-51d04f2808b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:38.922011 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6d75-55b4-470a-828f-51d04f2808b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:38.922285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6d75-55b4-470a-828f-51d04f2808b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:38.924015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bc2b6d75-55b4-470a-828f-51d04f2808b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:38.983844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b6d75-55b4-470a-828f-51d04f2808b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:38.985412 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b6d75-55b4-470a-828f-51d04f2808b1 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:38.995371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1341/2672] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:43.974926 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:44.036869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f3b60-889d-4c81-b29f-2966a0c78510 service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:44.041634 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:44.046324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:44.046324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:44.046324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] PATH_INFO: `/v3/users/ef4d1c0f8933476fb0d82fca60cb2499` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:44.046324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef4d1c0f8933476fb0d82fca60cb2499)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:44.046324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:44.216967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef4d1c0f8933476fb0d82fca60cb2499'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:44.217722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef4d1c0f8933476fb0d82fca60cb2499'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:44.231237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef4d1c0f8933476fb0d82fca60cb2499'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:44.231954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef4d1c0f8933476fb0d82fca60cb2499'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:44.238762 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef4d1c0f8933476fb0d82fca60cb2499'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:44.316470 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1332/2673] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:28:43 2022] DELETE /identity/v3/users/ef4d1c0f8933476fb0d82fca60cb2499 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:28:44.321134 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:44.321603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:44.322353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:44.340270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:44.341448 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:44.402300 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1342/2674] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:44.412615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:44.414587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:44.472107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e97aec-80d6-438e-84eb-c15204cdeb61 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:44.475830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:44.476972 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:44.477279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:44.477702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:44.486743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:44.488159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:44.498394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1333/2675] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:44.855521 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:44.857263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:44.871574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae375-7817-44e4-bfc9-64c6bf758474 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:44.876714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:44.877252 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:44.877533 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:44.877805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] PATH_INFO: `/v3/projects/f1194f0102d24a2085f776133058e992` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:44.879003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1194f0102d24a2085f776133058e992)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:44.880892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:44.973683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1194f0102d24a2085f776133058e992', 'request_id': 'req-ca481cf6-0fde-4186-9ee7-aaffc1808635'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.035910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1194f0102d24a2085f776133058e992', 'request_id': 'req-ca481cf6-0fde-4186-9ee7-aaffc1808635'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.042800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1194f0102d24a2085f776133058e992', 'request_id': 'req-ca481cf6-0fde-4186-9ee7-aaffc1808635'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.053744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] The token cache is being invalidate because project f1194f0102d24a2085f776133058e992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:28:45.054036 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.055343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.057007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1343/2676] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:28:44 2022] DELETE /identity/v3/projects/f1194f0102d24a2085f776133058e992 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:45.061005 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:45.070936 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca333a-2174-434b-b625-4d030fa5f86f service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:45.125508 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:45.126370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:45.126655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:45.126933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] PATH_INFO: `/v3/users/cca283a81dd745f79df28f08c096863a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:45.128117 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca283a81dd745f79df28f08c096863a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:45.130044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:45.283852 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca283a81dd745f79df28f08c096863a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.284461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca283a81dd745f79df28f08c096863a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.295653 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca283a81dd745f79df28f08c096863a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.296271 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca283a81dd745f79df28f08c096863a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.303946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-0ab51ae8-f61e-4628-bb02-665086b25df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca283a81dd745f79df28f08c096863a'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.367142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1334/2677] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:28:45 2022] DELETE /identity/v3/users/cca283a81dd745f79df28f08c096863a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:45.729363 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:45.730826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:45.743928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca481cf6-0fde-4186-9ee7-aaffc1808635 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:45.800476 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:45.801554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:45.801836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:45.802109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] PATH_INFO: `/v3/projects/df5c7ebbaf0441a7a6201f9eb56b795f` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:45.803270 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5c7ebbaf0441a7a6201f9eb56b795f)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:45.805721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:45.887143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5c7ebbaf0441a7a6201f9eb56b795f', 'request_id': 'req-0c59d452-27af-497d-9744-219ecb2af23b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.932972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5c7ebbaf0441a7a6201f9eb56b795f', 'request_id': 'req-0c59d452-27af-497d-9744-219ecb2af23b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.938479 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5c7ebbaf0441a7a6201f9eb56b795f', 'request_id': 'req-0c59d452-27af-497d-9744-219ecb2af23b'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.950055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] The token cache is being invalidate because project df5c7ebbaf0441a7a6201f9eb56b795f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:28:45.950361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.950972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0c59d452-27af-497d-9744-219ecb2af23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:45.952494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1344/2678] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:28:45 2022] DELETE /identity/v3/projects/df5c7ebbaf0441a7a6201f9eb56b795f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:45.957693 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b5b1-08e8-486b-9adf-0f5437f70051 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:45.957985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b5b1-08e8-486b-9adf-0f5437f70051 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:45.958262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b5b1-08e8-486b-9adf-0f5437f70051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:45.976449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8728b5b1-08e8-486b-9adf-0f5437f70051 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:45.977727 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8728b5b1-08e8-486b-9adf-0f5437f70051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:46.036292 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1335/2679] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:46.044444 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96bcf-c5d1-4210-81b4-fd0dbc5e3eeb None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.044735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96bcf-c5d1-4210-81b4-fd0dbc5e3eeb None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.045015 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96bcf-c5d1-4210-81b4-fd0dbc5e3eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.063133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f7c96bcf-c5d1-4210-81b4-fd0dbc5e3eeb None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:46.064330 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f7c96bcf-c5d1-4210-81b4-fd0dbc5e3eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:46.072950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1345/2680] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:46.077207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b5b1-08e8-486b-9adf-0f5437f70051 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.087722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b5b1-08e8-486b-9adf-0f5437f70051 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.092339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.092992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.093374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.093680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.094397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:28:46.094707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.096290 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:46.107899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1336/2681] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:28:46.112140 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c96bcf-c5d1-4210-81b4-fd0dbc5e3eeb None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.121822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c96bcf-c5d1-4210-81b4-fd0dbc5e3eeb None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.126637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.127343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.127631 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.127908 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.128598 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.130519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:46.226432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1346/2682] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:28:46 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:46.230562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.240744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441e01-129f-4af9-9bf3-529a8d9e9f4a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.297863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.298620 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.298910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.299189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.299884 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.301822 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:46.408341 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1337/2683] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:28:46 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:46.412686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.422956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361a97-feec-4ddb-9a0c-105fde6693f7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.428019 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.428703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.428996 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.429302 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.430055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.432422 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:46.444222 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1347/2684] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:46.448275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.458469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b144cd-8207-436b-b84b-146b35853a89 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.463795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b55a5-8e5d-42be-8cb4-f59ed0071d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.464454 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b55a5-8e5d-42be-8cb4-f59ed0071d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.464742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b55a5-8e5d-42be-8cb4-f59ed0071d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.465021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b55a5-8e5d-42be-8cb4-f59ed0071d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.465778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b55a5-8e5d-42be-8cb4-f59ed0071d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.467357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b55a5-8e5d-42be-8cb4-f59ed0071d72 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:46.477682 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1338/2685] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:46.481814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.491722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80480f-6459-4284-99a7-39ae639d7847 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.497239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.501718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.501718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.501718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] PATH_INFO: `/v3/projects/1c466739dc5e43c1a6c646959e3a7e17/users/29fb400a284645ebbe8482afcd681537/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.513935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c466739dc5e43c1a6c646959e3a7e17, user_id=29fb400a284645ebbe8482afcd681537, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.516639 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:46.613344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1348/2686] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:46 2022] PUT /identity/v3/projects/1c466739dc5e43c1a6c646959e3a7e17/users/29fb400a284645ebbe8482afcd681537/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:46.625718 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389a67-d669-4bea-8a66-639fc790b5d1 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.626012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389a67-d669-4bea-8a66-639fc790b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.626289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389a67-d669-4bea-8a66-639fc790b5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.652833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d1389a67-d669-4bea-8a66-639fc790b5d1 None None] MFA Rules not processed for user `29fb400a284645ebbe8482afcd681537`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:46.654113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d1389a67-d669-4bea-8a66-639fc790b5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:46.717906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1339/2687] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:46.722299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.787869 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3c28a-bc2b-493b-8025-d525c15b59eb admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.793528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.794220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.794536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.794798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.795482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.797544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:46.923327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1349/2688] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:28:46 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:46.927361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389a67-d669-4bea-8a66-639fc790b5d1 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:46.938862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389a67-d669-4bea-8a66-639fc790b5d1 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:46.994237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:46.994855 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:46.995140 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:46.995418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:46.996097 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:46.998063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:47.063757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1340/2689] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:28:46 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:28:47.067805 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:47.078186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968503f-8535-4769-bb65-cc5f38c08600 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:47.083304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:47.083961 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.084258 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.084536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.085290 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:47.087643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:47.097918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1350/2690] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:47.102863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:47.112680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee25ebb-eca4-4269-aaff-0fea1d58bb18 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:47.117346 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:47.118229 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.118514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.118787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] PATH_INFO: `/v3/projects/b5be705fe33941a1b89f253f3f578d75/users/8a1a79eea1ba49c498d561efc5305e54/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.132975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5be705fe33941a1b89f253f3f578d75, user_id=8a1a79eea1ba49c498d561efc5305e54, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:47.135624 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:47.219262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1341/2691] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:47 2022] PUT /identity/v3/projects/b5be705fe33941a1b89f253f3f578d75/users/8a1a79eea1ba49c498d561efc5305e54/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:28:47.223388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:47.233997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d30f9-f301-4eac-a2df-5b8947ca655e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:47.289063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ce327-016f-41db-8599-0839f9231645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:47.291049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce327-016f-41db-8599-0839f9231645 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.291344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce327-016f-41db-8599-0839f9231645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.291633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ce327-016f-41db-8599-0839f9231645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.292401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ce327-016f-41db-8599-0839f9231645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:47.294057 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ce327-016f-41db-8599-0839f9231645 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:47.304229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1351/2692] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:47.309223 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:47.319869 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5865-c30a-4a55-9631-f4b31ba4e884 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:47.325317 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac46f74-02c7-41dc-b419-b25d5621b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:47.326203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46f74-02c7-41dc-b419-b25d5621b1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.326552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46f74-02c7-41dc-b419-b25d5621b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.326838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac46f74-02c7-41dc-b419-b25d5621b1e1 admin admin] PATH_INFO: `/v3/projects/b5be705fe33941a1b89f253f3f578d75/users/8a1a79eea1ba49c498d561efc5305e54/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.328811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac46f74-02c7-41dc-b419-b25d5621b1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5be705fe33941a1b89f253f3f578d75, user_id=8a1a79eea1ba49c498d561efc5305e54, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:47.331790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac46f74-02c7-41dc-b419-b25d5621b1e1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:47.333902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.334195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.334472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.343183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1342/2693] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:47 2022] PUT /identity/v3/projects/b5be705fe33941a1b89f253f3f578d75/users/8a1a79eea1ba49c498d561efc5305e54/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:28:47.354368 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba664fd-5764-4e36-aaef-65ea99edc365 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.354701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba664fd-5764-4e36-aaef-65ea99edc365 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.354978 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba664fd-5764-4e36-aaef-65ea99edc365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.355361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] MFA Rules not processed for user `54abb874e0234293abd01646eaf0e5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:47.356568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:47.381228 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7ba664fd-5764-4e36-aaef-65ea99edc365 None None] MFA Rules not processed for user `8a1a79eea1ba49c498d561efc5305e54`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:47.384045 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7ba664fd-5764-4e36-aaef-65ea99edc365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:47.411136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1352/2694] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:28:47.451992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1343/2695] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:47.463802 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:47.465233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:47.522640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec91bec-0592-4e12-b1f9-a954d8743c4d None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:47.526401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5b9dd-5699-46cd-a4e0-a2707a020a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:47.527054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5b9dd-5699-46cd-a4e0-a2707a020a09 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.527345 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5b9dd-5699-46cd-a4e0-a2707a020a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.527622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5b9dd-5699-46cd-a4e0-a2707a020a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.537157 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5b9dd-5699-46cd-a4e0-a2707a020a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:47.538586 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5b9dd-5699-46cd-a4e0-a2707a020a09 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:47.548780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1353/2696] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:47.610042 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba664fd-5764-4e36-aaef-65ea99edc365 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:47.672330 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba664fd-5764-4e36-aaef-65ea99edc365 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:47.679312 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:47.680815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.681144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.681433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] PATH_INFO: `/v3/users/29fb400a284645ebbe8482afcd681537` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.682766 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fb400a284645ebbe8482afcd681537)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:47.684818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:47.832526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fb400a284645ebbe8482afcd681537'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:47.833221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fb400a284645ebbe8482afcd681537'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:47.845166 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fb400a284645ebbe8482afcd681537'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:47.845898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fb400a284645ebbe8482afcd681537'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:47.852648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fb400a284645ebbe8482afcd681537'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:47.935545 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1344/2697] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:28:47 2022] DELETE /identity/v3/users/29fb400a284645ebbe8482afcd681537 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:47.935654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:47.935654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:47.935654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:47.950849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:47.952083 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:48.013945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1354/2698] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:28:48.023767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:48.025415 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:48.091594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1a01a-5747-4ffa-b773-5dde7055e591 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:48.095203 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:48.095845 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:48.096129 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:48.096406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:48.105909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:48.107322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:48.116685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1345/2699] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:48.495187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:48.496644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:48.508426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85d51d-9b12-45a4-bda3-0c238152c64c None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:48.513265 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:48.515702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:48.515702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:48.515702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] PATH_INFO: `/v3/projects/1c466739dc5e43c1a6c646959e3a7e17` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:48.516093 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c466739dc5e43c1a6c646959e3a7e17)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:48.517768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:48.642336 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c466739dc5e43c1a6c646959e3a7e17', 'request_id': 'req-e71482ab-681d-49b9-bfc9-39a9bece660e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:48.715714 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c466739dc5e43c1a6c646959e3a7e17', 'request_id': 'req-e71482ab-681d-49b9-bfc9-39a9bece660e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:48.721786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c466739dc5e43c1a6c646959e3a7e17', 'request_id': 'req-e71482ab-681d-49b9-bfc9-39a9bece660e'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:48.738035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] The token cache is being invalidate because project 1c466739dc5e43c1a6c646959e3a7e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:28:48.738035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:48.738035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:48.738035 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1355/2700] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:28:48 2022] DELETE /identity/v3/projects/1c466739dc5e43c1a6c646959e3a7e17 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:48.740302 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:48.750904 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc07f1f-876a-4db5-85f6-2a217b59144a service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:48.807654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:48.808526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:48.808815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:48.809136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] PATH_INFO: `/v3/users/8a1a79eea1ba49c498d561efc5305e54` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:48.810324 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1a79eea1ba49c498d561efc5305e54)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:48.812275 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:48.992138 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1a79eea1ba49c498d561efc5305e54'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:48.992937 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1a79eea1ba49c498d561efc5305e54'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.004774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1a79eea1ba49c498d561efc5305e54'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.007638 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1a79eea1ba49c498d561efc5305e54'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.012862 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-d0f01c46-6fb4-49fb-80f3-6f0cf4901a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1a79eea1ba49c498d561efc5305e54'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.064168 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1346/2701] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:28:48 2022] DELETE /identity/v3/users/8a1a79eea1ba49c498d561efc5305e54 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:49.460666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:49.462557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:49.478621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71482ab-681d-49b9-bfc9-39a9bece660e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:49.551921 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:49.553825 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:49.554184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:49.554633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] PATH_INFO: `/v3/projects/b5be705fe33941a1b89f253f3f578d75` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:49.556729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5be705fe33941a1b89f253f3f578d75)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:49.558976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:49.703812 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5be705fe33941a1b89f253f3f578d75', 'request_id': 'req-7052cba2-857f-4f0a-8d11-6a004a9eee8c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.795882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5be705fe33941a1b89f253f3f578d75', 'request_id': 'req-7052cba2-857f-4f0a-8d11-6a004a9eee8c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.802213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5be705fe33941a1b89f253f3f578d75', 'request_id': 'req-7052cba2-857f-4f0a-8d11-6a004a9eee8c'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.816466 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] The token cache is being invalidate because project b5be705fe33941a1b89f253f3f578d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:28:49.816847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.817713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-7052cba2-857f-4f0a-8d11-6a004a9eee8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:49.819641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1356/2702] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:28:49 2022] DELETE /identity/v3/projects/b5be705fe33941a1b89f253f3f578d75 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:49.824716 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31323-fb19-46cb-a3da-38b03ee6cd3a None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:49.825608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31323-fb19-46cb-a3da-38b03ee6cd3a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:49.825608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e31323-fb19-46cb-a3da-38b03ee6cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:49.842868 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e3e31323-fb19-46cb-a3da-38b03ee6cd3a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:49.844130 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e3e31323-fb19-46cb-a3da-38b03ee6cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:49.904144 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1347/2703] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:49.911949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8a2d-3058-4881-8a16-5d88cb8efd56 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:49.912245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8a2d-3058-4881-8a16-5d88cb8efd56 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:49.912527 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8a2d-3058-4881-8a16-5d88cb8efd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:49.931141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-45eb8a2d-3058-4881-8a16-5d88cb8efd56 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:49.932344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-45eb8a2d-3058-4881-8a16-5d88cb8efd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:49.940484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1357/2704] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:49.944654 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31323-fb19-46cb-a3da-38b03ee6cd3a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:49.955965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e31323-fb19-46cb-a3da-38b03ee6cd3a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:49.960695 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:49.962001 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:49.962370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:49.962737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:49.963459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:28:49.963771 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:49.965463 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:49.977095 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1348/2705] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:28:49.981522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8a2d-3058-4881-8a16-5d88cb8efd56 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:49.997955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8a2d-3058-4881-8a16-5d88cb8efd56 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:49.997955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:49.997955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:49.997955 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:49.998368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:49.998368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:50.000620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:50.124264 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1358/2706] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:28:49 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:50.128436 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:50.139264 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f3fc4-2617-4b9b-b8d9-5da60386ec68 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:50.194257 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:50.194965 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:50.195246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:50.195523 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:50.196842 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:50.198910 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:50.265672 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1349/2707] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:28:50 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:50.269845 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:50.280567 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd175e5-107b-4a93-ac46-5f32298c3e9d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:50.285446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:50.286340 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:50.286625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:50.287409 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:50.287620 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:50.289247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:50.300559 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1359/2708] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:50.304365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:50.315289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8ccc-29a7-42e1-9cd7-5c9904a20d1f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:50.320599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52361bf8-1bd3-4be5-8b3c-ca2cbe509dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:50.322012 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361bf8-1bd3-4be5-8b3c-ca2cbe509dce admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:50.322300 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361bf8-1bd3-4be5-8b3c-ca2cbe509dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:50.322576 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361bf8-1bd3-4be5-8b3c-ca2cbe509dce admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:50.323309 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52361bf8-1bd3-4be5-8b3c-ca2cbe509dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:50.324915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52361bf8-1bd3-4be5-8b3c-ca2cbe509dce admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:50.337876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1350/2709] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:28:50.341945 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:50.352758 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab5ee4-8535-4341-a493-4bfb552884ae admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:50.357621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:50.358516 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:50.358849 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:50.359149 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] PATH_INFO: `/v3/projects/4b89c49e7ebf4fa5a624ab015189c065/users/cda2432ad08a4ce48ac8673a7c910e9f/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:50.374558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b89c49e7ebf4fa5a624ab015189c065, user_id=cda2432ad08a4ce48ac8673a7c910e9f, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:50.377186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:50.442935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1360/2710] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:50 2022] PUT /identity/v3/projects/4b89c49e7ebf4fa5a624ab015189c065/users/cda2432ad08a4ce48ac8673a7c910e9f/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:50.454953 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba3005-b9e7-4011-a85e-97ceacd11e32 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:50.455601 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba3005-b9e7-4011-a85e-97ceacd11e32 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:50.455977 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba3005-b9e7-4011-a85e-97ceacd11e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:50.487337 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-1eba3005-b9e7-4011-a85e-97ceacd11e32 None None] MFA Rules not processed for user `cda2432ad08a4ce48ac8673a7c910e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:50.488713 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1eba3005-b9e7-4011-a85e-97ceacd11e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:50.554698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1351/2711] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:28:50.565160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:50.567091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:50.630202 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca25b-c67a-4aaf-a19b-f0349230aa6a admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:50.634651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbb5e7-784b-410a-ab7d-984a359338b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:50.634998 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbb5e7-784b-410a-ab7d-984a359338b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:50.635278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbb5e7-784b-410a-ab7d-984a359338b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:50.635552 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbb5e7-784b-410a-ab7d-984a359338b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:50.644121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbb5e7-784b-410a-ab7d-984a359338b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:50.645591 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbb5e7-784b-410a-ab7d-984a359338b9 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:50.655519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1361/2712] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:50.675697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba3005-b9e7-4011-a85e-97ceacd11e32 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:50.750247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba3005-b9e7-4011-a85e-97ceacd11e32 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:50.755213 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:50.756096 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:50.756382 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:50.756661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] PATH_INFO: `/v3/users/cda2432ad08a4ce48ac8673a7c910e9f` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:50.757896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda2432ad08a4ce48ac8673a7c910e9f)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:50.760511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:50.989811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda2432ad08a4ce48ac8673a7c910e9f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:50.990558 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda2432ad08a4ce48ac8673a7c910e9f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:51.002143 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda2432ad08a4ce48ac8673a7c910e9f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:51.002805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda2432ad08a4ce48ac8673a7c910e9f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:51.009496 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda2432ad08a4ce48ac8673a7c910e9f'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:51.124377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1352/2713] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:28:50 2022] DELETE /identity/v3/users/cda2432ad08a4ce48ac8673a7c910e9f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:51.129712 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:51.130010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:51.130294 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:51.148855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:51.150704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:51.212855 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1362/2714] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:51.223423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:51.225092 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:51.330761 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90d48-203a-40c7-8fc1-38e4e2c42bc5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:51.336137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbdbb-a377-45e1-b012-0f3b9818c2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:51.337383 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbdbb-a377-45e1-b012-0f3b9818c2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:51.337684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbdbb-a377-45e1-b012-0f3b9818c2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:51.337968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbdbb-a377-45e1-b012-0f3b9818c2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:51.351478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acbdbb-a377-45e1-b012-0f3b9818c2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:51.354099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acbdbb-a377-45e1-b012-0f3b9818c2e4 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:51.366273 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1353/2715] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:28:52.068642 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:52.074861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:52.099279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afd784-fdd7-4ab9-bad9-5903038dd110 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:52.107356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:52.109058 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.109277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.109764 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] PATH_INFO: `/v3/projects/4b89c49e7ebf4fa5a624ab015189c065` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.112004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b89c49e7ebf4fa5a624ab015189c065)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:52.114378 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:52.238606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b89c49e7ebf4fa5a624ab015189c065', 'request_id': 'req-0eedec44-962a-4638-8be9-ddd4a9fd82a7'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:52.328010 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b89c49e7ebf4fa5a624ab015189c065', 'request_id': 'req-0eedec44-962a-4638-8be9-ddd4a9fd82a7'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:52.335243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b89c49e7ebf4fa5a624ab015189c065', 'request_id': 'req-0eedec44-962a-4638-8be9-ddd4a9fd82a7'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:52.348627 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] The token cache is being invalidate because project 4b89c49e7ebf4fa5a624ab015189c065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:28:52.348990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:52.355243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eedec44-962a-4638-8be9-ddd4a9fd82a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:28:52.355243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1363/2716] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:28:52 2022] DELETE /identity/v3/projects/4b89c49e7ebf4fa5a624ab015189c065 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:28:52.357115 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578db0-6474-4458-b7d9-f2d1ae66cace None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.357565 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578db0-6474-4458-b7d9-f2d1ae66cace None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.357707 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53578db0-6474-4458-b7d9-f2d1ae66cace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.378885 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-53578db0-6474-4458-b7d9-f2d1ae66cace None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:52.380186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-53578db0-6474-4458-b7d9-f2d1ae66cace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:52.501805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1354/2717] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:52.509693 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2348f-8779-4997-b39c-3f8aa4d0ad0f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.509976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2348f-8779-4997-b39c-3f8aa4d0ad0f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.510251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2348f-8779-4997-b39c-3f8aa4d0ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.530392 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-1ed2348f-8779-4997-b39c-3f8aa4d0ad0f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:52.531625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-1ed2348f-8779-4997-b39c-3f8aa4d0ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:52.541402 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1364/2718] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:52.545662 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578db0-6474-4458-b7d9-f2d1ae66cace None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:52.555957 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53578db0-6474-4458-b7d9-f2d1ae66cace None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:52.560765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:52.561708 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.561992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.562266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.562997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:28:52.563303 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:52.565121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:52.581318 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1355/2719] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:28:52.582480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2348f-8779-4997-b39c-3f8aa4d0ad0f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:52.593555 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2348f-8779-4997-b39c-3f8aa4d0ad0f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:52.598636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:52.599308 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.599618 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.599891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.600583 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:52.603372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:52.672163 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1365/2720] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:28:52 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:28:52.676481 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:52.687155 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cc658-7948-438e-b0d4-6c6a5f2b99c5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:52.745907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:52.746899 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.747180 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.747451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.748139 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:52.750103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:52.845499 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1356/2721] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:28:52 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:28:52.846708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:52.857024 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ebbfa-0e92-4907-83cb-169743081859 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:52.861791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:52.862455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.862738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.863139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.863797 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:52.865419 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:52.876663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1366/2722] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:52.880717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:52.891685 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120ebd7-eb0b-4133-a5ad-88dad96df764 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:52.896890 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaef55d-93f2-486c-a660-b4e30ade87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:52.897589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaef55d-93f2-486c-a660-b4e30ade87b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.897875 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaef55d-93f2-486c-a660-b4e30ade87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.898154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaef55d-93f2-486c-a660-b4e30ade87b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.899731 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaef55d-93f2-486c-a660-b4e30ade87b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:52.901269 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaef55d-93f2-486c-a660-b4e30ade87b2 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:52.911837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1357/2723] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:28:52.916042 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:52.925951 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b87f2-3cf0-4bbe-b770-dfbb8e473a91 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:52.931196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:52.932085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:52.932401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:52.932678 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] PATH_INFO: `/v3/projects/5183bbe288624336a2d1a7f039fc57eb/users/a973af72a7b64e829ef4309cf3f9e9c5/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:52.948726 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5183bbe288624336a2d1a7f039fc57eb, user_id=a973af72a7b64e829ef4309cf3f9e9c5, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:52.951413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:53.049674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1367/2724] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:28:52 2022] PUT /identity/v3/projects/5183bbe288624336a2d1a7f039fc57eb/users/a973af72a7b64e829ef4309cf3f9e9c5/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:28:53.061422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:53.061723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:53.062004 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:53.093050 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] MFA Rules not processed for user `a973af72a7b64e829ef4309cf3f9e9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:28:53.094295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:53.168319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1358/2725] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:28:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:28:53.179282 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:28:53.181952 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:28:53.240810 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff58df-702e-4669-a885-47b37b4273a8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:28:53.245260 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:28:53.245927 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:28:53.246254 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:28:53.246484 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:28:53.255090 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:28:53.256595 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:28:53.266189 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1368/2726] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:28:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:07.438121 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:07.439631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:07.495522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc044b2c-4087-42ee-b07a-1276182db1f7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:07.499137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:07.499775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:07.500062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:07.500340 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:07.502237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:07.562371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:07.563792 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:07.573743 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1359/2727] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:09.738918 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:09.740367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:09.818791 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077b7d-9d13-4ead-863e-c7507cee0fe4 service glance] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:09.827138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34d9d8-1494-4520-a326-8886b9b6dea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:09.827803 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34d9d8-1494-4520-a326-8886b9b6dea5 service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:09.828091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34d9d8-1494-4520-a326-8886b9b6dea5 service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:09.828368 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34d9d8-1494-4520-a326-8886b9b6dea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:09.830257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-3e34d9d8-1494-4520-a326-8886b9b6dea5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:09.844171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34d9d8-1494-4520-a326-8886b9b6dea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:09.845785 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34d9d8-1494-4520-a326-8886b9b6dea5 service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:09.861287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1369/2728] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:11.258961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:11.320560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7caec-42f9-4413-9792-34f2b825441f service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:11.325540 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:11.326411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:11.326733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:11.327010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] PATH_INFO: `/v3/users/a973af72a7b64e829ef4309cf3f9e9c5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:11.328413 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a973af72a7b64e829ef4309cf3f9e9c5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:11.330355 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:11.505589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a973af72a7b64e829ef4309cf3f9e9c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:11.506245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a973af72a7b64e829ef4309cf3f9e9c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:11.518803 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a973af72a7b64e829ef4309cf3f9e9c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:11.519519 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a973af72a7b64e829ef4309cf3f9e9c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:11.526789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a973af72a7b64e829ef4309cf3f9e9c5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:11.600555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1360/2729] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:29:11 2022] DELETE /identity/v3/users/a973af72a7b64e829ef4309cf3f9e9c5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:11.606014 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:11.606508 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:11.606614 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:11.624408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:11.625647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:11.683406 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1370/2730] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:11.692951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:11.694475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:11.750806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa0d4-d072-489a-84bd-43c3a7b9230d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:11.754505 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d2c79-244d-4da9-8157-29a706671810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:11.755157 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d2c79-244d-4da9-8157-29a706671810 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:11.755441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d2c79-244d-4da9-8157-29a706671810 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:11.755939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d2c79-244d-4da9-8157-29a706671810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:11.765703 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d2c79-244d-4da9-8157-29a706671810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:11.767125 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d2c79-244d-4da9-8157-29a706671810 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:11.777306 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1361/2731] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:12.174656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:12.176091 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:12.189577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db80b4-5fa7-407f-a49b-cc9a06ff0348 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:12.194760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:12.195634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.196537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.196836 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] PATH_INFO: `/v3/projects/5183bbe288624336a2d1a7f039fc57eb` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.199268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5183bbe288624336a2d1a7f039fc57eb)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:12.203279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:12.295287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5183bbe288624336a2d1a7f039fc57eb', 'request_id': 'req-02ea31a3-2427-44ef-a3a1-67febf4a830a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:12.344100 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5183bbe288624336a2d1a7f039fc57eb', 'request_id': 'req-02ea31a3-2427-44ef-a3a1-67febf4a830a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:12.350059 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5183bbe288624336a2d1a7f039fc57eb', 'request_id': 'req-02ea31a3-2427-44ef-a3a1-67febf4a830a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:12.362160 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] The token cache is being invalidate because project 5183bbe288624336a2d1a7f039fc57eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:29:12.362455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:12.363112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-02ea31a3-2427-44ef-a3a1-67febf4a830a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:12.364658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1371/2732] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:29:12 2022] DELETE /identity/v3/projects/5183bbe288624336a2d1a7f039fc57eb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:12.369697 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a085-99cf-4137-98d8-9b08dd7c32b9 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.371159 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a085-99cf-4137-98d8-9b08dd7c32b9 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.372181 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a085-99cf-4137-98d8-9b08dd7c32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.390967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-45c1a085-99cf-4137-98d8-9b08dd7c32b9 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:12.392193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-45c1a085-99cf-4137-98d8-9b08dd7c32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:12.453832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1362/2733] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:12.462023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb97c-dcf5-4e65-bee5-0474457af9fa None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.462317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb97c-dcf5-4e65-bee5-0474457af9fa None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.462592 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bb97c-dcf5-4e65-bee5-0474457af9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.482135 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-167bb97c-dcf5-4e65-bee5-0474457af9fa None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:12.483335 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-167bb97c-dcf5-4e65-bee5-0474457af9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:12.491236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1372/2734] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:12.496218 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a085-99cf-4137-98d8-9b08dd7c32b9 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:12.505870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a085-99cf-4137-98d8-9b08dd7c32b9 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:12.510897 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:12.511591 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.511907 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.512184 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.512901 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:29:12.513248 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:12.514831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:12.526618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1363/2735] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:29:12.530844 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bb97c-dcf5-4e65-bee5-0474457af9fa None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:12.539877 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bb97c-dcf5-4e65-bee5-0474457af9fa None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:12.545309 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:12.545890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.546173 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.546449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.547142 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:12.549194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:12.608703 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1373/2736] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:29:12 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:29:12.612992 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:12.624195 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8286ae1-fc13-4faf-a601-38f71588cd94 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:12.679156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:12.679915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.680205 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.680487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.681233 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:12.683991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:12.773020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1364/2737] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:29:12 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:29:12.777408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:12.788064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a013bc-37d6-46e9-82f7-37868a760123 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:12.794084 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:12.794834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.795193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.795557 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.796221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:12.797883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:12.809472 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1374/2738] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:12.813475 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:12.824017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57989aa-4325-46d3-b9af-3c92ef67d25a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:12.828734 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea2491-638d-4673-86c2-95cf30470180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:12.829418 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea2491-638d-4673-86c2-95cf30470180 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.829701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea2491-638d-4673-86c2-95cf30470180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.830006 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea2491-638d-4673-86c2-95cf30470180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.830946 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea2491-638d-4673-86c2-95cf30470180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:12.832516 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea2491-638d-4673-86c2-95cf30470180 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:12.843363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1365/2739] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:12.847407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:12.858151 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6af6-455a-4d67-beb5-88a562ca4692 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:12.862768 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:12.863634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:12.863915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:12.868528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] PATH_INFO: `/v3/projects/9fd0721f81a8461ba6e8e8a292be81d3/users/e2b19cf2de7641c1bdf5dc6f994b738e/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:12.880159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd0721f81a8461ba6e8e8a292be81d3, user_id=e2b19cf2de7641c1bdf5dc6f994b738e, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:12.882914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:12.991395 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1375/2740] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:12 2022] PUT /identity/v3/projects/9fd0721f81a8461ba6e8e8a292be81d3/users/e2b19cf2de7641c1bdf5dc6f994b738e/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:13.002258 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1257c68-9e29-463a-9cba-70e675b685ab None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:13.002616 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1257c68-9e29-463a-9cba-70e675b685ab None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:13.002839 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1257c68-9e29-463a-9cba-70e675b685ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:13.031999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-a1257c68-9e29-463a-9cba-70e675b685ab None None] MFA Rules not processed for user `e2b19cf2de7641c1bdf5dc6f994b738e`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:13.033242 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a1257c68-9e29-463a-9cba-70e675b685ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:13.113274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1366/2741] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:13.123965 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:13.125775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:13.192863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7133-36e3-4276-bb9f-9690ba2da7d9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:13.196569 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:13.197432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:13.197847 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:13.199977 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:13.209003 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:13.210489 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:13.219813 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1376/2742] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:13.302947 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3d4e1-5ca1-4ddb-8354-4f8e8046fec0 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:13.303202 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3d4e1-5ca1-4ddb-8354-4f8e8046fec0 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:13.303479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3d4e1-5ca1-4ddb-8354-4f8e8046fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:13.322070 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0ad3d4e1-5ca1-4ddb-8354-4f8e8046fec0 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:13.323993 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0ad3d4e1-5ca1-4ddb-8354-4f8e8046fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:13.387978 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1367/2743] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:29:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:13.504384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:13.505940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:13.576218 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dfb23-9610-41d6-a8ff-630a5c7498d3 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:13.581485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34c6ad-6898-41cc-bedd-ddfce31da35a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:13.582128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34c6ad-6898-41cc-bedd-ddfce31da35a service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:13.582992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34c6ad-6898-41cc-bedd-ddfce31da35a service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:13.582992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34c6ad-6898-41cc-bedd-ddfce31da35a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:13.591306 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34c6ad-6898-41cc-bedd-ddfce31da35a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:13.592923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34c6ad-6898-41cc-bedd-ddfce31da35a service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:13.600924 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1377/2744] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:29:17.223390 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3d4e1-5ca1-4ddb-8354-4f8e8046fec0 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:17.291197 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3d4e1-5ca1-4ddb-8354-4f8e8046fec0 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:17.296445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:17.297477 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:17.297757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:17.298031 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] PATH_INFO: `/v3/users/e2b19cf2de7641c1bdf5dc6f994b738e` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:17.299247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b19cf2de7641c1bdf5dc6f994b738e)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:17.301392 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:17.489959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b19cf2de7641c1bdf5dc6f994b738e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:17.491488 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b19cf2de7641c1bdf5dc6f994b738e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:17.509431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b19cf2de7641c1bdf5dc6f994b738e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:17.510622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b19cf2de7641c1bdf5dc6f994b738e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:17.522315 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b19cf2de7641c1bdf5dc6f994b738e'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:17.676943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1368/2745] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:29:17 2022] DELETE /identity/v3/users/e2b19cf2de7641c1bdf5dc6f994b738e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:17.681699 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:17.683237 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:17.683523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:17.702524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:17.703754 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:17.781815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1378/2746] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:17.782583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:17.784841 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:17.849201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f990d-22cb-48e8-ba92-efb2c8a31593 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:17.857660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257c530-5672-4bc2-90d4-db94a715dea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:17.858328 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257c530-5672-4bc2-90d4-db94a715dea6 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:17.858608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257c530-5672-4bc2-90d4-db94a715dea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:17.858900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257c530-5672-4bc2-90d4-db94a715dea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:17.868871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257c530-5672-4bc2-90d4-db94a715dea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:17.872329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257c530-5672-4bc2-90d4-db94a715dea6 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:17.888124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1369/2747] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:29:18.392975 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:18.394195 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:18.409153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57990e7-3616-4b73-aff2-38f37e6a17b7 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:18.426753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:18.428498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:18.428957 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:18.429210 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] PATH_INFO: `/v3/projects/9fd0721f81a8461ba6e8e8a292be81d3` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:18.430577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd0721f81a8461ba6e8e8a292be81d3)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:18.433906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:18.552984 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd0721f81a8461ba6e8e8a292be81d3', 'request_id': 'req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:18.601524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd0721f81a8461ba6e8e8a292be81d3', 'request_id': 'req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:18.613455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd0721f81a8461ba6e8e8a292be81d3', 'request_id': 'req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:18.634088 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] The token cache is being invalidate because project 9fd0721f81a8461ba6e8e8a292be81d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:29:18.635403 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:18.638263 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-0eb69c35-b906-4cdf-bc9e-9108cc4862d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:18.646310 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1379/2748] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:29:18 2022] DELETE /identity/v3/projects/9fd0721f81a8461ba6e8e8a292be81d3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:18.646789 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c4c5d-f619-457f-aef2-60c2563c106a None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:18.647249 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c4c5d-f619-457f-aef2-60c2563c106a None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:18.647342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c4c5d-f619-457f-aef2-60c2563c106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:18.670532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-575c4c5d-f619-457f-aef2-60c2563c106a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:18.672032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-575c4c5d-f619-457f-aef2-60c2563c106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:18.762894 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1370/2749] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:29:18.771891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620e67-1902-46c4-91ba-e64497f87307 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:18.772413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620e67-1902-46c4-91ba-e64497f87307 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:18.772556 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620e67-1902-46c4-91ba-e64497f87307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:18.805221 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-28620e67-1902-46c4-91ba-e64497f87307 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:18.806691 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-28620e67-1902-46c4-91ba-e64497f87307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:18.816760 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1380/2750] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:18.821281 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c4c5d-f619-457f-aef2-60c2563c106a None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:18.831657 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c4c5d-f619-457f-aef2-60c2563c106a None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:18.837059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:18.837759 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:18.838047 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:18.838325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:18.839658 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:29:18.839966 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:18.841748 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:18.855322 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1371/2751] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 18:29:18.859702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620e67-1902-46c4-91ba-e64497f87307 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:18.869519 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620e67-1902-46c4-91ba-e64497f87307 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:18.875526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:18.876425 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:18.877251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:18.877535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:18.878238 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:18.880177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:18.980882 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1381/2752] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:29:18 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:29:18.985107 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:18.996511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720229b-21f9-41f8-a1e6-6ad6018414f3 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:19.068579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:19.069224 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:19.069510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:19.069794 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:19.070506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:19.073744 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:19.196958 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1372/2753] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:29:18 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:29:19.200949 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:19.212051 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d0390-c884-4655-a933-b25d5042d44c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:19.221932 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:19.222837 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:19.223055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:19.223315 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:19.224090 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:19.225766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:19.243133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1382/2754] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:19.247416 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:19.258119 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796514-1834-482a-aefd-2c50a5605a2d admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:19.264491 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f433a2-c320-4abf-8c62-2a9c581fcaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:19.265208 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f433a2-c320-4abf-8c62-2a9c581fcaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:19.265497 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f433a2-c320-4abf-8c62-2a9c581fcaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:19.265775 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f433a2-c320-4abf-8c62-2a9c581fcaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:19.266513 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f433a2-c320-4abf-8c62-2a9c581fcaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:19.268108 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f433a2-c320-4abf-8c62-2a9c581fcaa5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:19.279984 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1373/2755] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:19.289268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:19.300637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018fdb-e98d-46e8-a900-7d945c0e20d1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:19.305745 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:19.306735 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:19.307092 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:19.307629 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] PATH_INFO: `/v3/projects/c5e5fd1b63024c6b85826db4430c49bb/users/f0d740f049f24f8693ae30c1fda54623/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:19.323605 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e5fd1b63024c6b85826db4430c49bb, user_id=f0d740f049f24f8693ae30c1fda54623, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:19.326487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:19.374995 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1383/2756] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:19 2022] PUT /identity/v3/projects/c5e5fd1b63024c6b85826db4430c49bb/users/f0d740f049f24f8693ae30c1fda54623/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:19.385200 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0f05-38f5-48d0-8b64-a3680474b685 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:19.386357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0f05-38f5-48d0-8b64-a3680474b685 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:19.386641 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0f05-38f5-48d0-8b64-a3680474b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:19.417701 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0f0a0f05-38f5-48d0-8b64-a3680474b685 None None] MFA Rules not processed for user `f0d740f049f24f8693ae30c1fda54623`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:19.418927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0f0a0f05-38f5-48d0-8b64-a3680474b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:19.492296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1374/2757] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:29:19.497647 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:19.569936 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe87e69-2ce1-4e44-affa-5778498eab00 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:19.576118 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:19.576721 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:19.577004 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:19.577359 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:19.578067 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:19.580498 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:19.699883 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1384/2758] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:29:19 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:29:19.704538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a0f05-38f5-48d0-8b64-a3680474b685 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:19.718145 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a0f05-38f5-48d0-8b64-a3680474b685 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:19.774656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:19.775327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:19.775607 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:19.775880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:19.777342 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:19.779325 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.019738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1375/2759] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:29:19 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:29:20.023814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.035603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08b5af-feb7-4301-8f91-63955b99ee7d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.040488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.041194 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.041482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.041829 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.042702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.044656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.057099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1385/2760] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:29:20.061304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.071424 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f7d18-5a7d-42e5-912d-082e78d5cd00 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.077279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172fe2a-9e39-4156-9a78-b9c95499fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.077974 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172fe2a-9e39-4156-9a78-b9c95499fa33 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.078262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172fe2a-9e39-4156-9a78-b9c95499fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.078547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172fe2a-9e39-4156-9a78-b9c95499fa33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.079268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172fe2a-9e39-4156-9a78-b9c95499fa33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.081129 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172fe2a-9e39-4156-9a78-b9c95499fa33 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.092587 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1376/2761] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:20.096902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.107416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b87d-05fc-4872-8d56-eaea2d15768e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.112044 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.112914 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.113235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.113510 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] PATH_INFO: `/v3/projects/96d3fb9a5ab84a94884c4be9f8731d26/users/21f642da258c4d95b7780ed8fc18c434/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.128120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d3fb9a5ab84a94884c4be9f8731d26, user_id=21f642da258c4d95b7780ed8fc18c434, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.130530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.208792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1386/2762] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:20 2022] PUT /identity/v3/projects/96d3fb9a5ab84a94884c4be9f8731d26/users/21f642da258c4d95b7780ed8fc18c434/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:20.219750 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b40db0-8b34-43a6-846c-c493dad98aa7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.220044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b40db0-8b34-43a6-846c-c493dad98aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.220370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b40db0-8b34-43a6-846c-c493dad98aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.249925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-99b40db0-8b34-43a6-846c-c493dad98aa7 None None] MFA Rules not processed for user `21f642da258c4d95b7780ed8fc18c434`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:20.251332 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-99b40db0-8b34-43a6-846c-c493dad98aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:20.337247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1377/2763] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:20.337801 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.414038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d136d-e17f-44af-adf0-95b06244450d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.419572 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.420231 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.420517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.420794 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.421514 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.423606 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.528582 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1387/2764] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:29:20 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:29:20.529659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b40db0-8b34-43a6-846c-c493dad98aa7 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.541562 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b40db0-8b34-43a6-846c-c493dad98aa7 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.607968 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.609008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.609304 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.609578 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.610268 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.612183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.679244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1378/2765] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:29:20 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:29:20.680580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.694637 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064b1f4-6fa1-4087-9393-5a0cd83caae5 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.700910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.701824 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.702288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.702560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.703285 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.705028 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.717162 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1388/2766] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:20.720956 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.735427 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e521881-bada-4a14-b5dc-aa3da01185fd admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.741037 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.742066 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.742574 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.743209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] PATH_INFO: `/v3/projects/6fbbd0dd9e5847f58f232c91fd6ea6b2/users/6e1835b093174c958a4adeceabddf04c/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.765126 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbbd0dd9e5847f58f232c91fd6ea6b2, user_id=6e1835b093174c958a4adeceabddf04c, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.768085 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.820557 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1379/2767] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:20 2022] PUT /identity/v3/projects/6fbbd0dd9e5847f58f232c91fd6ea6b2/users/6e1835b093174c958a4adeceabddf04c/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:20.824540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.836513 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cac0-89b5-4bc9-8920-a275fe51d9e3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.897154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a4e02-1e44-42c6-b2ef-d85a17ef710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.897835 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4e02-1e44-42c6-b2ef-d85a17ef710c admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.898124 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4e02-1e44-42c6-b2ef-d85a17ef710c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.898407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4e02-1e44-42c6-b2ef-d85a17ef710c admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.899133 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a4e02-1e44-42c6-b2ef-d85a17ef710c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.900757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a4e02-1e44-42c6-b2ef-d85a17ef710c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.915339 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1389/2768] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:20.917598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:20.928379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bdeaa-0453-484e-b5ce-604fa4fefc6a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:20.933921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:20.934898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:20.935253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:20.935598 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] PATH_INFO: `/v3/projects/6fbbd0dd9e5847f58f232c91fd6ea6b2/users/6e1835b093174c958a4adeceabddf04c/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:20.937677 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbbd0dd9e5847f58f232c91fd6ea6b2, user_id=6e1835b093174c958a4adeceabddf04c, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:20.940387 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:20.956059 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1380/2769] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:20 2022] PUT /identity/v3/projects/6fbbd0dd9e5847f58f232c91fd6ea6b2/users/6e1835b093174c958a4adeceabddf04c/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:21.019577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:21.019967 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:21.020320 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:21.060487 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] MFA Rules not processed for user `6e1835b093174c958a4adeceabddf04c`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:21.061800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:21.146560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1390/2770] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:21.154397 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:21.156753 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:21.235469 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6f7fe-b60f-49b2-a4bb-1ea7b51ea042 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:21.240547 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:21.241329 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:21.241729 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:21.242076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:21.310545 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:21.312690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:21.326209 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1381/2771] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:23.400866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:23.402765 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:23.414823 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51b728-3393-48b3-8d62-7b89fa0bcee5 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:23.418558 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:23.419199 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:23.419482 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:23.419757 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:23.483515 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:23.485101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:23.499159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1391/2772] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:24.950704 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:24.959599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2078b2-17b0-454f-a539-5592ee871cdd service cinder] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:24.963246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd75b26-0487-4c62-9672-b8d65e2ab530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:24.964078 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75b26-0487-4c62-9672-b8d65e2ab530 service cinder] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:24.964363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75b26-0487-4c62-9672-b8d65e2ab530 service cinder] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:24.964737 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75b26-0487-4c62-9672-b8d65e2ab530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:24.973864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd75b26-0487-4c62-9672-b8d65e2ab530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:24.975286 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd75b26-0487-4c62-9672-b8d65e2ab530 service cinder] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:24.984820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1382/2773] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:29.516657 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:29.581343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1bede-d7d4-4946-9302-e6286c09b743 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:29.586253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:29.587262 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:29.587580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:29.587860 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] PATH_INFO: `/v3/users/f0d740f049f24f8693ae30c1fda54623` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:29.589471 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d740f049f24f8693ae30c1fda54623)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:29.591771 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:29.752414 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d740f049f24f8693ae30c1fda54623'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:29.753159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d740f049f24f8693ae30c1fda54623'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:29.760451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d740f049f24f8693ae30c1fda54623'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:29.772682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d740f049f24f8693ae30c1fda54623'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:29.773369 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d740f049f24f8693ae30c1fda54623'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:29.852713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1392/2774] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:29:29 2022] DELETE /identity/v3/users/f0d740f049f24f8693ae30c1fda54623 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:29.858076 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:29.858543 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:29.859030 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:29.877571 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:29.878790 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:29.940970 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1383/2775] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:29:29.947667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:29.949761 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:30.007423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909f462-e5d7-462d-9c63-19e228becb05 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:30.011736 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:30.012379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:30.012663 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:30.012939 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:30.021982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:30.023599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:30.034138 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1393/2776] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:30.414367 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:30.415747 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:30.429210 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10cf7-123a-44fd-9fc9-8c36beff2497 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:30.434911 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:30.435787 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:30.436071 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:30.436351 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] PATH_INFO: `/v3/projects/c5e5fd1b63024c6b85826db4430c49bb` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:30.437585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e5fd1b63024c6b85826db4430c49bb)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:30.439763 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:30.534389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e5fd1b63024c6b85826db4430c49bb', 'request_id': 'req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.600863 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e5fd1b63024c6b85826db4430c49bb', 'request_id': 'req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.607422 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e5fd1b63024c6b85826db4430c49bb', 'request_id': 'req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.619113 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] The token cache is being invalidate because project c5e5fd1b63024c6b85826db4430c49bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:29:30.619411 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.620062 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-baee5fac-8ff1-46c5-a18a-71a5d4bc13d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.622279 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1384/2777] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:29:30 2022] DELETE /identity/v3/projects/c5e5fd1b63024c6b85826db4430c49bb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:30.626438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:30.635774 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abbe7-fb8d-404e-9be3-d52c6050e322 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:30.692176 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:30.693039 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:30.693360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:30.693638 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] PATH_INFO: `/v3/users/21f642da258c4d95b7780ed8fc18c434` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:30.694827 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f642da258c4d95b7780ed8fc18c434)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:30.696743 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:30.839032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8145-a450-4356-8e63-eee67684e90d None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:30.839880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8145-a450-4356-8e63-eee67684e90d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:30.840371 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8145-a450-4356-8e63-eee67684e90d None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:30.842433 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1385/2778] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:29:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:29:30.849584 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209fe5-6699-455a-b7dd-afe99a1ce94d None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:30.849880 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209fe5-6699-455a-b7dd-afe99a1ce94d None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:30.850251 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209fe5-6699-455a-b7dd-afe99a1ce94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:30.857919 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f642da258c4d95b7780ed8fc18c434'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.858640 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f642da258c4d95b7780ed8fc18c434'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.865364 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f642da258c4d95b7780ed8fc18c434'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.875741 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-c5209fe5-6699-455a-b7dd-afe99a1ce94d None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:30.877109 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-c5209fe5-6699-455a-b7dd-afe99a1ce94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:30.877718 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f642da258c4d95b7780ed8fc18c434'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.879455 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f642da258c4d95b7780ed8fc18c434'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:30.943253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1394/2779] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:29:30 2022] DELETE /identity/v3/users/21f642da258c4d95b7780ed8fc18c434 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:29:30.950985 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1386/2780] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:29:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:30.956458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:30.958063 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:31.020838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb3b2-add1-4eee-96ab-e14114bc2159 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:31.024780 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ec7b0-e56c-46b3-9887-54cb66143b17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '715e34300eef47d9aa2839cb3c5c5fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:31.025554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec7b0-e56c-46b3-9887-54cb66143b17 service glance] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.025863 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec7b0-e56c-46b3-9887-54cb66143b17 service glance] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.026137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ec7b0-e56c-46b3-9887-54cb66143b17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.093690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ec7b0-e56c-46b3-9887-54cb66143b17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:31.095049 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ec7b0-e56c-46b3-9887-54cb66143b17 service glance] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:31.106816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1395/2781] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:29:31.294514 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f82d6f-bbc9-478f-a268-2bc30d4ffd34 None None] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.294808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f82d6f-bbc9-478f-a268-2bc30d4ffd34 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.295090 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f82d6f-bbc9-478f-a268-2bc30d4ffd34 None None] PATH_INFO: `/` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.297017 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1387/2782] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 18:29:31.303365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.303661 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.303942 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.322056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] MFA Rules not processed for user `9b842d30b55c48bf8f375bdcc829bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:31.325376 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:31.351445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f82d6f-bbc9-478f-a268-2bc30d4ffd34 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:31.353552 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-b4f82d6f-bbc9-478f-a268-2bc30d4ffd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:31.379759 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1396/2783] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:31.392143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:31.393544 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:31.404775 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750c67-a866-4deb-bc80-0806d1bfccac None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:31.408554 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963acd-bf2b-4bcb-b2b2-fc1956b2e9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:31.409229 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963acd-bf2b-4bcb-b2b2-fc1956b2e9fa service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.409522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963acd-bf2b-4bcb-b2b2-fc1956b2e9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.409798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963acd-bf2b-4bcb-b2b2-fc1956b2e9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.416885 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3963acd-bf2b-4bcb-b2b2-fc1956b2e9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:31.418632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3963acd-bf2b-4bcb-b2b2-fc1956b2e9fa service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:31.423455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f82d6f-bbc9-478f-a268-2bc30d4ffd34 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:31.426536 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1397/2784] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:31.429188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:31.429188 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.429447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.429666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] PATH_INFO: `/v3/projects/96d3fb9a5ab84a94884c4be9f8731d26` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.430849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d3fb9a5ab84a94884c4be9f8731d26)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:31.432781 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:31.517159 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cdd4c-2722-4c76-8a00-6283a518bc96 None None] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.517458 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cdd4c-2722-4c76-8a00-6283a518bc96 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.517743 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cdd4c-2722-4c76-8a00-6283a518bc96 None None] PATH_INFO: `/` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.519624 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1398/2785] 10.222.0.87 () {54 vars in 921 bytes} [Wed Feb 16 18:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 18:29:31.524679 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c53e5-c03a-4395-ac14-476e7a9dff01 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.524966 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c53e5-c03a-4395-ac14-476e7a9dff01 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.525271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c53e5-c03a-4395-ac14-476e7a9dff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.544164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-cc5c53e5-c03a-4395-ac14-476e7a9dff01 None None] MFA Rules not processed for user `28dfb9c84dda4d6799a490a009e867df`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:31.548673 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-cc5c53e5-c03a-4395-ac14-476e7a9dff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:31.548860 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d3fb9a5ab84a94884c4be9f8731d26', 'request_id': 'req-9c045b6f-1c80-4147-babb-d1d0adac0520'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.612959 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d3fb9a5ab84a94884c4be9f8731d26', 'request_id': 'req-9c045b6f-1c80-4147-babb-d1d0adac0520'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.616670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1399/2786] 10.222.0.87 () {58 vars in 1018 bytes} [Wed Feb 16 18:29:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:29:31.618749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d3fb9a5ab84a94884c4be9f8731d26', 'request_id': 'req-9c045b6f-1c80-4147-babb-d1d0adac0520'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.627993 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c53e5-c03a-4395-ac14-476e7a9dff01 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:31.631038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] The token cache is being invalidate because project 96d3fb9a5ab84a94884c4be9f8731d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:29:31.634711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.634711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.634711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1388/2787] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:29:31 2022] DELETE /identity/v3/projects/96d3fb9a5ab84a94884c4be9f8731d26 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:29:31.639007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:31.640443 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:31.682177 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c53e5-c03a-4395-ac14-476e7a9dff01 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:31.685972 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:31.686621 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.686913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.687196 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.689020 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:31.702257 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:31.703700 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:31.704881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c045b6f-1c80-4147-babb-d1d0adac0520 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:31.709864 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:31.710702 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:31.710975 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:31.711247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] PATH_INFO: `/v3/users/6e1835b093174c958a4adeceabddf04c` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:31.712461 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1835b093174c958a4adeceabddf04c)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:31.714991 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:31.715271 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1400/2788] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 18:29:31.860948 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1835b093174c958a4adeceabddf04c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.861745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1835b093174c958a4adeceabddf04c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.873544 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1835b093174c958a4adeceabddf04c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.874259 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1835b093174c958a4adeceabddf04c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.881153 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-4e50f5da-a4a8-40b5-9534-fe684da9dbad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1835b093174c958a4adeceabddf04c'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:31.972384 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1389/2789] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:29:31 2022] DELETE /identity/v3/users/6e1835b093174c958a4adeceabddf04c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:32.437585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:32.447820 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccfdc8-9ed0-4f86-ba1e-bd1ef85a3af5 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:32.506681 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:32.507540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:32.507826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:32.508104 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] PATH_INFO: `/v3/projects/6fbbd0dd9e5847f58f232c91fd6ea6b2` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:32.509325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbbd0dd9e5847f58f232c91fd6ea6b2)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:32.511615 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:32.602287 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbbd0dd9e5847f58f232c91fd6ea6b2', 'request_id': 'req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:32.653389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbbd0dd9e5847f58f232c91fd6ea6b2', 'request_id': 'req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:32.659739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbbd0dd9e5847f58f232c91fd6ea6b2', 'request_id': 'req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:32.671667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] The token cache is being invalidate because project 6fbbd0dd9e5847f58f232c91fd6ea6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:29:32.671954 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:32.672577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-76dbea62-0b0f-422e-b57a-3fb70c7bdd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:29:32.674294 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1401/2790] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:29:32 2022] DELETE /identity/v3/projects/6fbbd0dd9e5847f58f232c91fd6ea6b2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:32.679295 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a8610-5b52-4250-9084-26c731d79081 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:32.679583 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a8610-5b52-4250-9084-26c731d79081 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:32.679916 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a8610-5b52-4250-9084-26c731d79081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:32.698007 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-898a8610-5b52-4250-9084-26c731d79081 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:32.700038 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-898a8610-5b52-4250-9084-26c731d79081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:32.760393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1390/2791] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:32.769616 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224c9c-cd4b-4c0f-be11-085b511d8594 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:32.769910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224c9c-cd4b-4c0f-be11-085b511d8594 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:32.770187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224c9c-cd4b-4c0f-be11-085b511d8594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:32.790187 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-f1224c9c-cd4b-4c0f-be11-085b511d8594 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:32.791596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f1224c9c-cd4b-4c0f-be11-085b511d8594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:32.800522 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1402/2792] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:32.804933 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a8610-5b52-4250-9084-26c731d79081 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:32.814920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a8610-5b52-4250-9084-26c731d79081 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:32.819783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:32.820441 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:32.820723 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:32.820997 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:32.821740 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:29:32.822044 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:32.824160 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:32.836008 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1391/2793] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:29:32.841114 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224c9c-cd4b-4c0f-be11-085b511d8594 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:32.850589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224c9c-cd4b-4c0f-be11-085b511d8594 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:32.855400 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:32.856085 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:32.856478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:32.859056 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:32.860432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:32.862670 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:32.945401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1403/2794] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:29:32 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:29:32.950084 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:32.960419 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c33e5-58e8-4c4a-84fa-a84007542b46 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:33.015617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:33.016311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:33.016599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:33.016887 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:33.017668 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:33.019680 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:33.093656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1392/2795] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:29:32 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:29:33.097982 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:33.109107 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb409e60-41a9-4e08-803f-3126c2038b7c admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:33.113894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:33.114580 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:33.114866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:33.115141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:33.115857 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:33.117480 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:33.130445 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1404/2796] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:33.134615 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:33.148128 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc90e8-7fea-4f2e-9ed6-758bb3e5826f admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:33.155447 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeabf5-07e8-4ad2-9cb6-25a983004068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:33.156212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeabf5-07e8-4ad2-9cb6-25a983004068 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:33.156567 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeabf5-07e8-4ad2-9cb6-25a983004068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:33.156914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeabf5-07e8-4ad2-9cb6-25a983004068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:33.157829 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeabf5-07e8-4ad2-9cb6-25a983004068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:33.159466 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeabf5-07e8-4ad2-9cb6-25a983004068 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:33.171177 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1393/2797] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:29:33.175623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:33.187871 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28ed1-2852-4052-9b46-7714f63fa1af admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:33.191429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:33.192446 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:33.197379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:33.197379 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] PATH_INFO: `/v3/projects/28e3def0fcef4ccc84b9642e9c3f25b1/users/94d49077424d40cb849da5a1814dcf33/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:33.211652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e3def0fcef4ccc84b9642e9c3f25b1, user_id=94d49077424d40cb849da5a1814dcf33, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:33.217316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:33.304451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1405/2798] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:33 2022] PUT /identity/v3/projects/28e3def0fcef4ccc84b9642e9c3f25b1/users/94d49077424d40cb849da5a1814dcf33/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:33.310430 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec64f-2f80-46e5-b934-110ed7c6e90f None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:33.312442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec64f-2f80-46e5-b934-110ed7c6e90f None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:33.312442 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aec64f-2f80-46e5-b934-110ed7c6e90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:33.330136 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-d7aec64f-2f80-46e5-b934-110ed7c6e90f None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:33.331882 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-d7aec64f-2f80-46e5-b934-110ed7c6e90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:33.393014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1394/2799] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:29:33.403517 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:33.405295 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:33.462819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f0fd7-d6e5-4cc5-9715-60e218c57fdc admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:33.467488 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:33.470217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:33.470500 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:33.470776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:33.481156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:33.482597 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:33.492686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1406/2800] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:34.024365 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666b08-990d-4c5a-b29e-71e76b29e386 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:34.024906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666b08-990d-4c5a-b29e-71e76b29e386 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:34.024906 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666b08-990d-4c5a-b29e-71e76b29e386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:34.046217 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7d666b08-990d-4c5a-b29e-71e76b29e386 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:34.047456 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7d666b08-990d-4c5a-b29e-71e76b29e386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:34.104314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1395/2801] 10.222.0.87 () {58 vars in 1009 bytes} [Wed Feb 16 18:29:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:34.116992 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:34.118401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:34.186568 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606bcab-2832-44d5-8327-8741c8dac182 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:34.191694 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:34.192354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:34.192646 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:34.192933 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:34.202906 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:34.204547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:34.213485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1407/2802] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:29:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 18:29:40.872493 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203406d-27e5-4713-9d21-efe6cbbb9a14 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:40.873833 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203406d-27e5-4713-9d21-efe6cbbb9a14 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:40.874536 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203406d-27e5-4713-9d21-efe6cbbb9a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:40.939579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-9203406d-27e5-4713-9d21-efe6cbbb9a14 None None] MFA Rules not processed for user `94d49077424d40cb849da5a1814dcf33`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:40.942696 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9203406d-27e5-4713-9d21-efe6cbbb9a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:41.054555 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1396/2803] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:41.059938 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:41.072245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441b4b-0555-4e9c-a8ce-aeca07b538aa service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:41.078830 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:41.079677 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:41.080043 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:41.080435 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:41.081534 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:41.083800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:42.162278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1408/2804] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:29:41 2022] POST /identity/v3/projects => generated 371 bytes in 1103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:29:42.166509 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203406d-27e5-4713-9d21-efe6cbbb9a14 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:42.177844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203406d-27e5-4713-9d21-efe6cbbb9a14 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:42.239818 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:42.240503 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:42.240795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:42.241072 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:42.241805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:42.243749 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:42.311409 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1397/2805] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:29:42 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 18:29:42.315341 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:42.326462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888581d5-bcea-4471-8465-e0e76c9e94ad admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:42.331734 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:42.332398 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:42.332683 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:42.332958 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:42.333723 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:42.335349 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:42.347273 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1409/2806] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:29:42.351656 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:42.362726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbed223-26fb-4a7a-9c0b-17fd098507f7 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:42.367720 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:42.368636 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:42.368923 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:42.369237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] PATH_INFO: `/v3/projects/50d013cd851344b8a35aad4978d26a3f/users/8cb80b7dc1704893a04ac94f859b3ad5/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:42.384589 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d013cd851344b8a35aad4978d26a3f, user_id=8cb80b7dc1704893a04ac94f859b3ad5, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:42.387455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:42.453967 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1398/2807] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:42 2022] PUT /identity/v3/projects/50d013cd851344b8a35aad4978d26a3f/users/8cb80b7dc1704893a04ac94f859b3ad5/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:42.458154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:42.469428 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239901cb-a70c-44bf-a3b1-cb05d1c16cde admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:42.525574 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:42.526245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:42.527147 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:42.527426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:42.528139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:42.529786 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:42.543303 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1410/2808] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 18:29:42.544848 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:42.555148 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ee9cf-4ef7-4a29-8be1-b0dc13878af4 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:42.563524 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1bd4b-23b7-4b84-8b8e-094a0d38d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:42.564363 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1bd4b-23b7-4b84-8b8e-094a0d38d39f admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:42.564649 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1bd4b-23b7-4b84-8b8e-094a0d38d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:42.564925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1bd4b-23b7-4b84-8b8e-094a0d38d39f admin admin] PATH_INFO: `/v3/projects/50d013cd851344b8a35aad4978d26a3f/users/8cb80b7dc1704893a04ac94f859b3ad5/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:42.566964 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1bd4b-23b7-4b84-8b8e-094a0d38d39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d013cd851344b8a35aad4978d26a3f, user_id=8cb80b7dc1704893a04ac94f859b3ad5, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:42.569698 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1bd4b-23b7-4b84-8b8e-094a0d38d39f admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:42.582124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1399/2809] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:29:42 2022] PUT /identity/v3/projects/50d013cd851344b8a35aad4978d26a3f/users/8cb80b7dc1704893a04ac94f859b3ad5/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:29:45.193599 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:45.251373 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6832a2-db88-445d-b47b-180af85b7b95 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:45.301641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:45.302297 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:45.302584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:45.302866 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:45.304826 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:45.369023 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:45.371396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:45.380892 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1411/2810] 10.222.0.87 () {60 vars in 1396 bytes} [Wed Feb 16 18:29:45 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:48.216689 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a3731-b599-4084-ae3e-873386b37ab7 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:48.217669 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a3731-b599-4084-ae3e-873386b37ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:48.217951 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a3731-b599-4084-ae3e-873386b37ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:48.247327 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5c9a3731-b599-4084-ae3e-873386b37ab7 None None] MFA Rules not processed for user `8cb80b7dc1704893a04ac94f859b3ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:48.248556 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5c9a3731-b599-4084-ae3e-873386b37ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:48.336137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1400/2811] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:29:48.346530 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:48.348630 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:48.459370 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c924a-6708-4e42-8e0d-0c3ec7c7c9f5 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:48.468110 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:48.468861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:48.469279 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:48.469651 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:48.471665 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a7161-de92-4574-aed9-e4f57c8d5fe1 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:48.472019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a7161-de92-4574-aed9-e4f57c8d5fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:48.472240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a7161-de92-4574-aed9-e4f57c8d5fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:48.500049 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5d2a7161-de92-4574-aed9-e4f57c8d5fe1 None None] MFA Rules not processed for user `266555accbbd443fa51c26734d5a2f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:48.502434 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5d2a7161-de92-4574-aed9-e4f57c8d5fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:48.541800 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:48.544329 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:48.554064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1412/2812] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:29:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:29:48.567154 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1401/2813] 10.222.0.87 () {58 vars in 967 bytes} [Wed Feb 16 18:29:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:29:48.580375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:29:48.653728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25de8-115c-4688-bd58-b1a3a867c4ed service nova] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:29:48.653728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9450573df8c6430a8271e86f15954d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:29:48.653728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:48.653728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:48.654288 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:48.662230 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:29:48.663739 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:29:48.672888 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1413/2814] 10.222.0.87 () {60 vars in 1384 bytes} [Wed Feb 16 18:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 18:29:51.042837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:29:51.043379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:29:51.043379 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:29:51.061459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] MFA Rules not processed for user `94d49077424d40cb849da5a1814dcf33`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:29:51.062666 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:29:51.069742 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1402/2815] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:29:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:09.634762 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:09.645316 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c131-82b4-433e-9363-25d9a5e26aaf service swift] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:09.648940 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:09.649625 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:09.649907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:09.650184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:09.652108 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:09.666636 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:09.668106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:09.679923 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1414/2816] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:30:10.785928 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:10.787444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:10.799594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfaa3c-4960-4ed1-bf8c-a448cb2242db None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:10.803266 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:10.803903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:10.804189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:10.804468 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:10.806237 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:10.819725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:10.821230 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:10.833465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1403/2817] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:30:27.608034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:27.617236 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6944f-6c58-437a-83bf-7d41d49ade57 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:27.620766 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:27.621438 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:27.621720 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:27.621997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:27.631054 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:27.632526 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:27.642268 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1415/2818] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:30:38.893270 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:38.901788 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8cd5-b944-49ac-955f-44b5048c32e6 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:38.905548 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:38.906185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:38.906537 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:38.906760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:38.908677 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:38.972250 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:38.973795 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:38.983102 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1404/2819] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:30:42.808384 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:42.809589 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:42.822727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d9754-b87a-4938-ab55-b6fb4d414bc7 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:42.827185 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:42.828038 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:42.828495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:42.828772 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] PATH_INFO: `/v3/users/f2171ec4fc004821a9981919929ec56d` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:42.829974 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2171ec4fc004821a9981919929ec56d)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:42.832299 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:42.991267 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2171ec4fc004821a9981919929ec56d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:42.991913 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2171ec4fc004821a9981919929ec56d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:42.998478 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2171ec4fc004821a9981919929ec56d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.011950 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2171ec4fc004821a9981919929ec56d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.012590 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-2cd8040b-95f6-4460-a89a-871000cd4c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2171ec4fc004821a9981919929ec56d'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.086538 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1416/2820] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:30:42 2022] DELETE /identity/v3/users/f2171ec4fc004821a9981919929ec56d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:43.311299 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:43.330830 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afbf4a-7a39-4454-abd3-053e2eb1c2b3 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:43.379539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:43.380407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:43.380691 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:43.380969 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] PATH_INFO: `/v3/projects/f578810a0a59485687a431fe9130087f` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:43.382190 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f578810a0a59485687a431fe9130087f)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:43.384084 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:43.482925 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f578810a0a59485687a431fe9130087f', 'request_id': 'req-7fd6fb26-0afa-4474-a112-7da5662ed920'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.646529 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f578810a0a59485687a431fe9130087f', 'request_id': 'req-7fd6fb26-0afa-4474-a112-7da5662ed920'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.652828 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f578810a0a59485687a431fe9130087f', 'request_id': 'req-7fd6fb26-0afa-4474-a112-7da5662ed920'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.664754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] The token cache is being invalidate because project f578810a0a59485687a431fe9130087f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:30:43.665054 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.665774 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-7fd6fb26-0afa-4474-a112-7da5662ed920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:43.667319 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1405/2821] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:30:43 2022] DELETE /identity/v3/projects/f578810a0a59485687a431fe9130087f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:43.672434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54b7f-e690-4acb-9553-440eb9ec616a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:43.672729 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54b7f-e690-4acb-9553-440eb9ec616a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:43.673007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54b7f-e690-4acb-9553-440eb9ec616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:43.691603 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-40b54b7f-e690-4acb-9553-440eb9ec616a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:43.692811 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-40b54b7f-e690-4acb-9553-440eb9ec616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:43.751220 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1417/2822] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:43.759098 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d79b1-4740-4d93-b8a9-14a10adf2063 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:43.759444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d79b1-4740-4d93-b8a9-14a10adf2063 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:43.759725 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d79b1-4740-4d93-b8a9-14a10adf2063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:43.778176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-bd6d79b1-4740-4d93-b8a9-14a10adf2063 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:43.779357 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-bd6d79b1-4740-4d93-b8a9-14a10adf2063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:43.787891 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1406/2823] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:43.792040 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b54b7f-e690-4acb-9553-440eb9ec616a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:43.801909 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b54b7f-e690-4acb-9553-440eb9ec616a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:43.806496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:43.807143 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:43.807429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:43.807709 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:43.808423 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:30:43.808968 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:43.810354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:43.821643 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1418/2824] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:30:43.825835 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d79b1-4740-4d93-b8a9-14a10adf2063 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:43.835838 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d79b1-4740-4d93-b8a9-14a10adf2063 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:43.841020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:43.841659 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:43.841941 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:43.842211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:43.843026 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:43.845021 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:43.934103 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1407/2825] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:30:43 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:30:43.938086 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:43.948578 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c6334-5c9f-4baf-887c-ef50857af49d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:44.004539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:44.005235 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:44.005540 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:44.005796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:44.006486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:44.008399 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:44.104193 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1419/2826] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:30:43 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:30:44.108394 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:44.120236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a9107-1586-45d5-a998-2c41b59fc7ca admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:44.125333 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:44.126478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:44.126478 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:44.126690 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:44.127393 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:44.129010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:44.139799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1408/2827] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:30:44.144317 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:44.154698 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34bdf3-3a45-4d2e-8654-ff19018a525e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:44.160205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d520e-14e6-406c-8776-3cc7998af63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:44.160798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d520e-14e6-406c-8776-3cc7998af63a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:44.161099 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d520e-14e6-406c-8776-3cc7998af63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:44.161388 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d520e-14e6-406c-8776-3cc7998af63a admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:44.162106 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d520e-14e6-406c-8776-3cc7998af63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:44.163682 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d520e-14e6-406c-8776-3cc7998af63a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:44.173654 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1420/2828] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:30:44.178156 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:44.188061 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80e03c-16f9-4587-a4b0-7025abf44a81 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:44.192878 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:44.193796 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:44.194083 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:44.194359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] PATH_INFO: `/v3/projects/0011146242194d6c8fa6ff135313ac5a/users/f5abbf908f604cf39b46d7b9e4610c78/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:44.209857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0011146242194d6c8fa6ff135313ac5a, user_id=f5abbf908f604cf39b46d7b9e4610c78, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:44.212542 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:44.269522 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1409/2829] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:30:44 2022] PUT /identity/v3/projects/0011146242194d6c8fa6ff135313ac5a/users/f5abbf908f604cf39b46d7b9e4610c78/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:44.280112 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2066-7b7d-4824-8c36-63d0ed623b9f None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:44.281155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2066-7b7d-4824-8c36-63d0ed623b9f None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:44.281155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2066-7b7d-4824-8c36-63d0ed623b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:44.308796 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-36ae2066-7b7d-4824-8c36-63d0ed623b9f None None] MFA Rules not processed for user `f5abbf908f604cf39b46d7b9e4610c78`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:44.310034 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-36ae2066-7b7d-4824-8c36-63d0ed623b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:44.374900 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1421/2830] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:44.386585 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:44.388388 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:44.465032 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e163e-42be-4a40-ab9f-bf6af3d4f19b admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:44.470618 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bb581-f331-4b87-991a-7b3fd87807df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:44.471262 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb581-f331-4b87-991a-7b3fd87807df service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:44.472118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb581-f331-4b87-991a-7b3fd87807df service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:44.472532 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb581-f331-4b87-991a-7b3fd87807df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:44.480194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bb581-f331-4b87-991a-7b3fd87807df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:44.481805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bb581-f331-4b87-991a-7b3fd87807df service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:44.491011 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1410/2831] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:30:53.617074 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2066-7b7d-4824-8c36-63d0ed623b9f None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:53.675223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2066-7b7d-4824-8c36-63d0ed623b9f None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:53.679690 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:53.680541 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:53.680821 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:53.681121 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] PATH_INFO: `/v3/users/f5abbf908f604cf39b46d7b9e4610c78` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:53.682280 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5abbf908f604cf39b46d7b9e4610c78)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:53.684170 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:53.853816 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5abbf908f604cf39b46d7b9e4610c78'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:53.854464 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5abbf908f604cf39b46d7b9e4610c78'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:53.861128 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5abbf908f604cf39b46d7b9e4610c78'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:53.873457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5abbf908f604cf39b46d7b9e4610c78'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:53.874174 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5abbf908f604cf39b46d7b9e4610c78'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:53.937963 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1422/2832] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:30:53 2022] DELETE /identity/v3/users/f5abbf908f604cf39b46d7b9e4610c78 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:53.944056 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:53.944594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:53.944724 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:53.963854 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:53.965174 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:54.024389 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1411/2833] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:30:54.034243 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:54.035702 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:54.100506 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cdffd-bc1a-4d1b-a224-977b4e811aa7 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:54.104410 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd2a65-7d60-4d21-9a9f-2815fd12db8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:54.105155 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2a65-7d60-4d21-9a9f-2815fd12db8e service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:54.105447 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2a65-7d60-4d21-9a9f-2815fd12db8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:54.105727 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd2a65-7d60-4d21-9a9f-2815fd12db8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:54.115684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd2a65-7d60-4d21-9a9f-2815fd12db8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:54.117145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd2a65-7d60-4d21-9a9f-2815fd12db8e service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:54.127494 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1423/2834] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:30:54.524717 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:54.526359 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:54.539785 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb7d34-e045-4afb-983b-8a7967c20f75 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:54.545176 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:54.546020 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:54.546320 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:54.546581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] PATH_INFO: `/v3/projects/0011146242194d6c8fa6ff135313ac5a` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:54.547770 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0011146242194d6c8fa6ff135313ac5a)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:54.549776 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:54.654594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0011146242194d6c8fa6ff135313ac5a', 'request_id': 'req-a07a11e7-1359-4cbf-b803-811807318167'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:54.737100 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0011146242194d6c8fa6ff135313ac5a', 'request_id': 'req-a07a11e7-1359-4cbf-b803-811807318167'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:54.743193 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0011146242194d6c8fa6ff135313ac5a', 'request_id': 'req-a07a11e7-1359-4cbf-b803-811807318167'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:54.757335 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] The token cache is being invalidate because project 0011146242194d6c8fa6ff135313ac5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:30:54.757622 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:54.758510 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-a07a11e7-1359-4cbf-b803-811807318167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:54.760035 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1412/2835] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:30:54 2022] DELETE /identity/v3/projects/0011146242194d6c8fa6ff135313ac5a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:54.765407 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1a80-7b08-4589-9449-cb9b024406f3 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:54.766266 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1a80-7b08-4589-9449-cb9b024406f3 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:54.766632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1a80-7b08-4589-9449-cb9b024406f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:54.790129 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a67b1a80-7b08-4589-9449-cb9b024406f3 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:54.791411 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a67b1a80-7b08-4589-9449-cb9b024406f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:54.867523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1424/2836] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:54.876404 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e135d82-9fb7-45fa-ac9a-2d7eb2d4b78c None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:54.876721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e135d82-9fb7-45fa-ac9a-2d7eb2d4b78c None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:54.876999 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e135d82-9fb7-45fa-ac9a-2d7eb2d4b78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:54.900881 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-0e135d82-9fb7-45fa-ac9a-2d7eb2d4b78c None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:54.902162 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0e135d82-9fb7-45fa-ac9a-2d7eb2d4b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:54.910370 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1413/2837] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:54.915344 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1a80-7b08-4589-9449-cb9b024406f3 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:54.925469 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1a80-7b08-4589-9449-cb9b024406f3 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:54.930834 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:54.931492 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:54.931777 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:54.932055 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:54.932776 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79635) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:30:54.933137 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:54.934743 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:54.948069 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1425/2838] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:30:54.952539 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e135d82-9fb7-45fa-ac9a-2d7eb2d4b78c None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:54.963063 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e135d82-9fb7-45fa-ac9a-2d7eb2d4b78c None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:54.967874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:54.968533 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:54.968820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:54.969122 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:54.969821 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:54.972573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.060294 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1414/2839] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:30:54 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:30:55.064617 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.075166 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4316-fd50-4de3-b1d8-e0807044e5a2 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.136437 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.137145 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.137429 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.137704 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.138404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.140321 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.226987 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1426/2840] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:30:55 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:30:55.229594 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.240914 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a40b14-08c8-4a6d-9402-de0430bbdf94 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.248635 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.249364 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.249655 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.249935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.250661 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.252243 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.266827 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1415/2841] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:30:55.267795 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.279156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534a08-7b05-4eb0-9dcc-26c6c2b6169d admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.284200 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e72a8-266e-4f50-b782-78e8f566716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.284867 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e72a8-266e-4f50-b782-78e8f566716a admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.285186 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e72a8-266e-4f50-b782-78e8f566716a admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.285462 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e72a8-266e-4f50-b782-78e8f566716a admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.286832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e72a8-266e-4f50-b782-78e8f566716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.288602 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e72a8-266e-4f50-b782-78e8f566716a admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.300902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1427/2842] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:30:55.306361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.320124 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c74b1-b872-4e2e-9f18-5c827b8712be admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.326261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.327575 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.327909 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.328186 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] PATH_INFO: `/v3/projects/a1b342050e614e02873fd079a06b2ca8/users/32a35a276dbb404a8b5f2bb2e6687224/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.345581 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b342050e614e02873fd079a06b2ca8, user_id=32a35a276dbb404a8b5f2bb2e6687224, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.348521 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.446407 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1416/2843] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:30:55 2022] PUT /identity/v3/projects/a1b342050e614e02873fd079a06b2ca8/users/32a35a276dbb404a8b5f2bb2e6687224/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:55.456579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b4937-6e41-4699-b504-52a839103bce None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.456846 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b4937-6e41-4699-b504-52a839103bce None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.457355 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b4937-6e41-4699-b504-52a839103bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.485365 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-ed6b4937-6e41-4699-b504-52a839103bce None None] MFA Rules not processed for user `32a35a276dbb404a8b5f2bb2e6687224`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:55.486573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-ed6b4937-6e41-4699-b504-52a839103bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:55.550144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1428/2844] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:55.555137 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.617726 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03244e2d-6480-4cae-a028-f6ae2d4f3b01 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.622287 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.623207 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.623486 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.623757 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] PATH_INFO: `/v3/projects` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.624445 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.626391 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.704711 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1417/2845] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:30:55 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:30:55.717381 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b4937-6e41-4699-b504-52a839103bce None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.728239 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b4937-6e41-4699-b504-52a839103bce None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.784383 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.785141 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.785361 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.785641 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] PATH_INFO: `/v3/users` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.786327 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.788413 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.858048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1429/2846] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:30:55 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:30:55.862118 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.872739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44379923-9cac-4a6c-a5d4-cf4d1b822202 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.877444 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.878094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.878374 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.878648 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.879426 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.881647 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:55.892052 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1418/2847] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:30:55.896417 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:55.906449 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41bd18-5656-4541-94d4-0d1106199a1e admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:55.911353 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:55.916372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:55.916372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:55.916372 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] PATH_INFO: `/v3/projects/d28b860d721244bcb78ce8a921b42584/users/2d5055d0c12f4c69b441e84cb2b5bb84/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:55.928467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28b860d721244bcb78ce8a921b42584, user_id=2d5055d0c12f4c69b441e84cb2b5bb84, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:55.931247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:56.029832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1430/2848] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:30:55 2022] PUT /identity/v3/projects/d28b860d721244bcb78ce8a921b42584/users/2d5055d0c12f4c69b441e84cb2b5bb84/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:56.033805 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:56.044194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be949-2aba-4d07-ae15-63f0c9a9f393 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:56.098331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e09b-3728-49e1-a081-6354d14bbfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:56.099673 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e09b-3728-49e1-a081-6354d14bbfbf admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:56.099961 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e09b-3728-49e1-a081-6354d14bbfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:56.100238 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e09b-3728-49e1-a081-6354d14bbfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:56.100954 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e09b-3728-49e1-a081-6354d14bbfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:56.102560 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e09b-3728-49e1-a081-6354d14bbfbf admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:56.112631 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1419/2849] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:30:56.117537 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:56.127523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab8621-3d16-4236-a6de-16d4d47a7d38 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:56.132130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:56.132971 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:56.133278 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:56.133548 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] PATH_INFO: `/v3/projects/d28b860d721244bcb78ce8a921b42584/users/2d5055d0c12f4c69b441e84cb2b5bb84/roles/fe3a6b9f0c504a2e8a7ab838026036b5` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:56.135477 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28b860d721244bcb78ce8a921b42584, user_id=2d5055d0c12f4c69b441e84cb2b5bb84, role_id=fe3a6b9f0c504a2e8a7ab838026036b5)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:56.138123 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:56.148707 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1431/2850] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:30:56 2022] PUT /identity/v3/projects/d28b860d721244bcb78ce8a921b42584/users/2d5055d0c12f4c69b441e84cb2b5bb84/roles/fe3a6b9f0c504a2e8a7ab838026036b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:56.159861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe11d8-e938-451f-9967-6d3ee7e62c57 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:56.160150 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe11d8-e938-451f-9967-6d3ee7e62c57 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:56.160423 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe11d8-e938-451f-9967-6d3ee7e62c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:56.187034 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-8cfe11d8-e938-451f-9967-6d3ee7e62c57 None None] MFA Rules not processed for user `2d5055d0c12f4c69b441e84cb2b5bb84`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:56.188253 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8cfe11d8-e938-451f-9967-6d3ee7e62c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:56.254623 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1420/2851] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:56.269387 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:56.271089 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:56.327401 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad451c-ce84-4f7c-8ff4-437138a33652 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:56.331394 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be59fd-171a-4ea2-a145-a6fa7934a7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:56.332037 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be59fd-171a-4ea2-a145-a6fa7934a7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:56.332573 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be59fd-171a-4ea2-a145-a6fa7934a7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:56.332912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be59fd-171a-4ea2-a145-a6fa7934a7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:56.342666 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be59fd-171a-4ea2-a145-a6fa7934a7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:56.344205 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be59fd-171a-4ea2-a145-a6fa7934a7e5 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:56.354153 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1432/2852] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:30:59.255806 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe11d8-e938-451f-9967-6d3ee7e62c57 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:59.319023 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe11d8-e938-451f-9967-6d3ee7e62c57 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:59.323738 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:59.324609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:59.324898 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:59.325212 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] PATH_INFO: `/v3/users/32a35a276dbb404a8b5f2bb2e6687224` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:59.326501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a35a276dbb404a8b5f2bb2e6687224)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:59.328573 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:59.590609 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a35a276dbb404a8b5f2bb2e6687224'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:59.591272 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a35a276dbb404a8b5f2bb2e6687224'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:59.603460 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a35a276dbb404a8b5f2bb2e6687224'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:59.604142 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a35a276dbb404a8b5f2bb2e6687224'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:59.612797 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a35a276dbb404a8b5f2bb2e6687224'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:30:59.708867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1421/2853] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:30:59 2022] DELETE /identity/v3/users/32a35a276dbb404a8b5f2bb2e6687224 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:30:59.713389 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:59.713915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:59.714018 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:59.732255 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:30:59.733504 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:59.793356 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1433/2854] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:30:59.804111 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:30:59.805617 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:30:59.866246 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f1ac-9d31-4637-9520-b99bc4ace24a admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:30:59.869981 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:30:59.870638 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:30:59.870921 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:30:59.871201 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:30:59.880889 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:30:59.882520 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:30:59.892408 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1422/2855] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:31:00.299432 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:00.300928 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:00.315546 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f16ea-7cb7-436f-b3b7-cecad42c044a None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:00.330819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:00.330819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:00.330819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:00.330819 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] PATH_INFO: `/v3/projects/a1b342050e614e02873fd079a06b2ca8` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:00.331461 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b342050e614e02873fd079a06b2ca8)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:00.332632 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:00.454658 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b342050e614e02873fd079a06b2ca8', 'request_id': 'req-364acadc-4ec1-421e-aa79-bcc091425bb9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.542098 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b342050e614e02873fd079a06b2ca8', 'request_id': 'req-364acadc-4ec1-421e-aa79-bcc091425bb9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.548281 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b342050e614e02873fd079a06b2ca8', 'request_id': 'req-364acadc-4ec1-421e-aa79-bcc091425bb9'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.559523 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] The token cache is being invalidate because project a1b342050e614e02873fd079a06b2ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:31:00.559810 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.560460 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.562027 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1434/2856] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:31:00 2022] DELETE /identity/v3/projects/a1b342050e614e02873fd079a06b2ca8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:00.566236 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:00.576733 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4d214-bb1e-4732-a2b6-a31a9ec31f91 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:00.638289 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:00.639161 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:00.639449 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:00.639732 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] PATH_INFO: `/v3/users/2d5055d0c12f4c69b441e84cb2b5bb84` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:00.640944 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5055d0c12f4c69b441e84cb2b5bb84)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:00.642903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:00.818105 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5055d0c12f4c69b441e84cb2b5bb84'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.818756 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5055d0c12f4c69b441e84cb2b5bb84'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.830808 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5055d0c12f4c69b441e84cb2b5bb84'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.831439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5055d0c12f4c69b441e84cb2b5bb84'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.839024 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-96f87969-acac-4e11-a535-04ca5947b166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5055d0c12f4c69b441e84cb2b5bb84'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:00.920377 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1423/2857] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:31:00 2022] DELETE /identity/v3/users/2d5055d0c12f4c69b441e84cb2b5bb84 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:01.331539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:01.333325 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:01.360634 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364acadc-4ec1-421e-aa79-bcc091425bb9 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:01.423188 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:01.424061 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:01.424348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:01.424623 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] PATH_INFO: `/v3/projects/d28b860d721244bcb78ce8a921b42584` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:01.425862 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28b860d721244bcb78ce8a921b42584)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:01.427763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:01.549935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28b860d721244bcb78ce8a921b42584', 'request_id': 'req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:01.629503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28b860d721244bcb78ce8a921b42584', 'request_id': 'req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:01.636171 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28b860d721244bcb78ce8a921b42584', 'request_id': 'req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:01.648241 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] The token cache is being invalidate because project d28b860d721244bcb78ce8a921b42584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:31:01.648539 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:01.649223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-ce15ae98-bb8e-4bf2-9b8c-c518ba1e58d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:01.650994 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1435/2858] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:31:01 2022] DELETE /identity/v3/projects/d28b860d721244bcb78ce8a921b42584 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:01.656831 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176e72-4270-40a9-be72-9b33d77e5456 None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:01.657361 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176e72-4270-40a9-be72-9b33d77e5456 None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:01.657458 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176e72-4270-40a9-be72-9b33d77e5456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:01.676534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-02176e72-4270-40a9-be72-9b33d77e5456 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:31:01.677857 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-02176e72-4270-40a9-be72-9b33d77e5456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:01.737476 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1424/2859] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 18:31:01.745525 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ff1e-14aa-4a57-a3bd-73d56e510011 None None] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:01.745815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ff1e-14aa-4a57-a3bd-73d56e510011 None None] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:01.746209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899ff1e-14aa-4a57-a3bd-73d56e510011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:01.768708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.auth.core [None req-a899ff1e-14aa-4a57-a3bd-73d56e510011 None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79635) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:31:01.768708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-a899ff1e-14aa-4a57-a3bd-73d56e510011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:01.773783 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1436/2860] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:31:01.778064 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176e72-4270-40a9-be72-9b33d77e5456 None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:01.787599 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176e72-4270-40a9-be72-9b33d77e5456 None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:01.792844 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:01.793538 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:01.793820 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:01.794099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] PATH_INFO: `/v3/domains` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:01.794832 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 18:31:01.795141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:01.796745 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:01.808915 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1425/2861] 10.222.0.87 () {58 vars in 1152 bytes} [Wed Feb 16 18:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 18:31:01.813245 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899ff1e-14aa-4a57-a3bd-73d56e510011 None None] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:01.823180 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899ff1e-14aa-4a57-a3bd-73d56e510011 None None] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:01.828213 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:01.828881 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:01.829217 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:01.829467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:01.830154 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:01.832048 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:01.928912 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1437/2862] 10.222.0.87 () {60 vars in 1152 bytes} [Wed Feb 16 18:31:01 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:31:01.940421 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:01.951088 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4950d-181e-4c8a-95ef-dfaf79899611 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:02.008767 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:02.009479 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:02.009769 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:02.010048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] PATH_INFO: `/v3/users` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:02.010760 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:02.012660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:02.116431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1426/2863] 10.222.0.87 () {60 vars in 1143 bytes} [Wed Feb 16 18:31:01 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 18:31:02.120233 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:02.130828 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815d26c-70f8-435e-8ef6-3c8dc617dea4 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:02.135798 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:02.136528 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:02.136841 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:02.137146 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:02.137861 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:02.139453 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:02.151081 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1438/2864] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:31:02.155684 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:02.167553 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02451716-df9a-4f8b-9283-3af4688b1984 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:02.172650 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c47eaa-fcec-458a-96f4-53f8ed638179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:02.178432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47eaa-fcec-458a-96f4-53f8ed638179 admin admin] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:02.178432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47eaa-fcec-458a-96f4-53f8ed638179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:02.178432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47eaa-fcec-458a-96f4-53f8ed638179 admin admin] PATH_INFO: `/v3/roles` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:02.178432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c47eaa-fcec-458a-96f4-53f8ed638179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:02.178432 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c47eaa-fcec-458a-96f4-53f8ed638179 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:02.190580 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1427/2865] 10.222.0.87 () {58 vars in 1121 bytes} [Wed Feb 16 18:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 18:31:02.191685 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:02.205763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4020053-f4ba-402f-86d1-240bbdef7d6b admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:02.208524 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:02.209451 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:02.210354 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:02.210701 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] PATH_INFO: `/v3/projects/fc06638ac0b94b389f11f6fe1a9c3e7c/users/a4d87041bf564954b66b9cc15f349664/roles/49988fd7322b428281a0ca4fe1b6fd51` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:02.227072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc06638ac0b94b389f11f6fe1a9c3e7c, user_id=a4d87041bf564954b66b9cc15f349664, role_id=49988fd7322b428281a0ca4fe1b6fd51)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:02.229915 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:02.310674 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1439/2866] 10.222.0.87 () {60 vars in 1482 bytes} [Wed Feb 16 18:31:02 2022] PUT /identity/v3/projects/fc06638ac0b94b389f11f6fe1a9c3e7c/users/a4d87041bf564954b66b9cc15f349664/roles/49988fd7322b428281a0ca4fe1b6fd51 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 18:31:02.322876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:02.323194 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:02.323484 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:02.350739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] MFA Rules not processed for user `a4d87041bf564954b66b9cc15f349664`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:31:02.352331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:02.416065 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1428/2867] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:31:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:31:02.426184 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:02.428139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:02.486109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98628ba-d244-44b8-b87a-c9205fa93cc3 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:02.489894 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '829b4ad50f8441248c0b6d5259b89fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:02.490543 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:02.490832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:02.491206 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:02.499692 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:02.501223 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:02.510686 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1440/2868] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:31:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:31:03.583296 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:03.585380 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:03.641900 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541886-7014-4ca0-a485-cbd651cb2ecc None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:03.645534 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:03.646211 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:03.646498 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:03.646778 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:03.649530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:03.711570 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:03.712995 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:03.722754 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1429/2869] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:31:11.355814 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:11.357815 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:11.372656 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569894-3ed8-42f0-842b-a3f1ae70d336 service cinder] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:11.377596 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:11.378468 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:11.378753 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:11.379030 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] PATH_INFO: `/v3/users/54abb874e0234293abd01646eaf0e5a0` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:11.380211 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54abb874e0234293abd01646eaf0e5a0)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:11.383006 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:11.608485 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54abb874e0234293abd01646eaf0e5a0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:11.609144 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54abb874e0234293abd01646eaf0e5a0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:11.616889 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54abb874e0234293abd01646eaf0e5a0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:11.628434 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54abb874e0234293abd01646eaf0e5a0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:11.629120 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54abb874e0234293abd01646eaf0e5a0'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:11.743375 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1441/2870] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:31:11 2022] DELETE /identity/v3/users/54abb874e0234293abd01646eaf0e5a0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:12.009297 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:12.020097 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0be31-adc8-45a6-a056-e2de3070dbd6 service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:12.077506 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:12.078526 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:12.078819 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:12.079099 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] PATH_INFO: `/v3/projects/bbc85d2f47ed42ae9d13c15932375126` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:12.080280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc85d2f47ed42ae9d13c15932375126)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:12.082245 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:12.177429 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc85d2f47ed42ae9d13c15932375126', 'request_id': 'req-cd65c936-2f95-49b3-abb7-7a48a809d4b5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.242014 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc85d2f47ed42ae9d13c15932375126', 'request_id': 'req-cd65c936-2f95-49b3-abb7-7a48a809d4b5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.247183 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc85d2f47ed42ae9d13c15932375126', 'request_id': 'req-cd65c936-2f95-49b3-abb7-7a48a809d4b5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.259096 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] The token cache is being invalidate because project bbc85d2f47ed42ae9d13c15932375126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:31:12.259381 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.260019 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.261579 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1430/2871] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:31:12 2022] DELETE /identity/v3/projects/bbc85d2f47ed42ae9d13c15932375126 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:12.265633 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:12.267101 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:12.280976 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0050711-81ad-47e6-be59-b7793b97f5b1 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:12.339396 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:12.340276 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:12.340560 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:12.340838 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] PATH_INFO: `/v3/users/34c8769a593f4aed8d094c3419cdd07f` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:12.342064 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c8769a593f4aed8d094c3419cdd07f)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:12.344164 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:12.477490 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c8769a593f4aed8d094c3419cdd07f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.478334 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c8769a593f4aed8d094c3419cdd07f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.485045 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c8769a593f4aed8d094c3419cdd07f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.496667 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c8769a593f4aed8d094c3419cdd07f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.497332 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c8769a593f4aed8d094c3419cdd07f'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:12.548209 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1442/2872] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:31:12 2022] DELETE /identity/v3/users/34c8769a593f4aed8d094c3419cdd07f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:12.779973 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:12.782406 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:12.796896 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65c936-2f95-49b3-abb7-7a48a809d4b5 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:12.855619 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:12.856511 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:12.859244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:12.859244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] PATH_INFO: `/v3/projects/7e85c9eb2121480ea7d1ec086fdd2185` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:12.859244 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e85c9eb2121480ea7d1ec086fdd2185)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:12.860428 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:12.953074 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e85c9eb2121480ea7d1ec086fdd2185', 'request_id': 'req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:13.038850 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e85c9eb2121480ea7d1ec086fdd2185', 'request_id': 'req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:13.044459 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e85c9eb2121480ea7d1ec086fdd2185', 'request_id': 'req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:13.055871 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] The token cache is being invalidate because project 7e85c9eb2121480ea7d1ec086fdd2185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:31:13.066739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:13.066739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-8a0a1dd3-72ca-4d12-8d39-f024b237ac20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:13.066739 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1431/2873] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:31:12 2022] DELETE /identity/v3/projects/7e85c9eb2121480ea7d1ec086fdd2185 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:40.693109 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:40.694575 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:40.709017 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf735-d6b5-4b59-a946-9cb1c439ff03 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:40.765259 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:40.766130 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:40.766416 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:40.766688 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] PATH_INFO: `/v3/users/a4d87041bf564954b66b9cc15f349664` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:40.767891 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d87041bf564954b66b9cc15f349664)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:40.769842 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:40.963251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d87041bf564954b66b9cc15f349664'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:40.963935 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d87041bf564954b66b9cc15f349664'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:40.971684 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d87041bf564954b66b9cc15f349664'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:40.984404 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d87041bf564954b66b9cc15f349664'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:40.985060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d87041bf564954b66b9cc15f349664'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:41.074584 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1443/2874] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:31:40 2022] DELETE /identity/v3/users/a4d87041bf564954b66b9cc15f349664 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:31:41.079487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] REQUEST_METHOD: `POST` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:41.079986 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:41.080094 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:41.099010 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.auth.core [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] MFA Rules not processed for user `9e0166f6ee734994acd210881999ef69`. Rule list: `[]` (Enabled: `True`). {{(pid=79636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 18:31:41.100215 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:41.162046 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1432/2875] 10.222.0.87 () {58 vars in 957 bytes} [Wed Feb 16 18:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 18:31:41.173041 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:41.179277 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:41.247708 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738276d-0a90-4a29-ad10-7170998b6a78 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:41.251156 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:41.251853 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:41.252136 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:41.252408 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:41.261360 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:41.262822 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:41.271910 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1444/2876] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:31:41.674800 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:31:41.676206 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:31:41.691935 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861db80-e0d2-49e2-ac06-7b528dbb554b None None] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:31:41.697311 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:31:41.698172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:31:41.698487 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:31:41.698836 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] PATH_INFO: `/v3/projects/fc06638ac0b94b389f11f6fe1a9c3e7c` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:31:41.700765 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc06638ac0b94b389f11f6fe1a9c3e7c)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:31:41.702660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:31:41.801280 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc06638ac0b94b389f11f6fe1a9c3e7c', 'request_id': 'req-998cca3b-6961-4926-9678-5bb3c36ac2ed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:41.857501 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc06638ac0b94b389f11f6fe1a9c3e7c', 'request_id': 'req-998cca3b-6961-4926-9678-5bb3c36ac2ed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:41.863247 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc06638ac0b94b389f11f6fe1a9c3e7c', 'request_id': 'req-998cca3b-6961-4926-9678-5bb3c36ac2ed'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:41.874874 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] The token cache is being invalidate because project fc06638ac0b94b389f11f6fe1a9c3e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79636) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:31:41.875172 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:41.875811 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:31:41.877414 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1433/2877] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:31:41 2022] DELETE /identity/v3/projects/fc06638ac0b94b389f11f6fe1a9c3e7c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:32:21.019890 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:32:21.021496 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:21.083355 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60597f42-4599-4b52-bae9-d72ec1ebb950 service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:32:21.130788 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:32:21.131426 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:32:21.131711 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:32:21.131991 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:32:21.134343 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:21.143561 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:32:21.144997 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:32:21.153585 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1445/2878] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:32:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:32:41.883867 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:32:41.885451 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:41.900613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cca3b-6961-4926-9678-5bb3c36ac2ed admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:32:41.904240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b842d30b55c48bf8f375bdcc829bf57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:32:41.904876 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:32:41.905191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:32:41.905465 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:32:41.907595 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:41.917783 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:32:41.919185 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:32:41.927199 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1434/2879] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:32:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:32:42.327467 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:32:42.328903 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:42.413769 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aa19c-5ab3-4cb0-865e-609a1dd6937b service neutron] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:32:42.419348 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:32:42.420025 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:32:42.420304 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:32:42.420579 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:32:42.422347 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:42.434009 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:32:42.435622 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:32:42.445486 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1446/2880] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:32:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:32:43.096943 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:32:43.098837 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:43.173722 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a805219-1bd7-4fb4-a8f4-47976b1ee27c service neutron] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:32:43.185352 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:32:43.189331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:32:43.189331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:32:43.189331 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:32:43.189613 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:32:43.203455 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:32:43.205349 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:32:43.218448 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1435/2881] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:32:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:33:18.322978 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:33:18.343990 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575340fb-68bb-47fa-9429-ad4250c45c70 service placement] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:33:18.349139 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:33:18.349779 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:33:18.350060 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:33:18.350333 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:33:18.352078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:33:18.375628 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:33:18.377247 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:33:18.387072 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1447/2882] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:33:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:34:11.423048 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:34:11.453314 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391307a-2d92-4e96-a67f-83fd3bfa2df2 service nova] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:34:11.459067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:34:11.460261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:34:11.460261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:34:11.460261 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:34:11.462339 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:34:11.490189 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:34:11.491927 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:34:11.503160 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1436/2883] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:34:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:34:14.045067 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:34:14.058547 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1af08-de36-4037-855b-05b14885977d service placement] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:34:14.064907 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dfb9c84dda4d6799a490a009e867df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:34:14.066503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] REQUEST_METHOD: `GET` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:34:14.066503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:34:14.066503 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:34:14.068253 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:34:14.080832 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:34:14.082457 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:34:14.093612 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1448/2884] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:34:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 18:34:24.528232 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:34:24.530721 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:34:24.644274 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723eb802-34aa-41d3-a93f-e0b4f89316f2 service nova] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:34:24.649608 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:34:24.655473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:34:24.655473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:34:24.655473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] PATH_INFO: `/v3/users/94d49077424d40cb849da5a1814dcf33` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:34:24.655473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d49077424d40cb849da5a1814dcf33)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:34:24.655473 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:34:24.850221 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d49077424d40cb849da5a1814dcf33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:24.850849 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d49077424d40cb849da5a1814dcf33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:24.863240 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d49077424d40cb849da5a1814dcf33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:24.863939 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d49077424d40cb849da5a1814dcf33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:24.870764 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d49077424d40cb849da5a1814dcf33'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:24.938141 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1437/2885] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:34:24 2022] DELETE /identity/v3/users/94d49077424d40cb849da5a1814dcf33 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:34:25.217251 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:34:25.227728 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75720c25-6d63-418a-94b9-92e261f8eaee service nova] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:34:25.292470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:34:25.293470 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:34:25.293644 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:34:25.293922 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] PATH_INFO: `/v3/projects/28e3def0fcef4ccc84b9642e9c3f25b1` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:34:25.295652 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e3def0fcef4ccc84b9642e9c3f25b1)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:34:25.297744 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:34:25.464722 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e3def0fcef4ccc84b9642e9c3f25b1', 'request_id': 'req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.555947 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e3def0fcef4ccc84b9642e9c3f25b1', 'request_id': 'req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.562000 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e3def0fcef4ccc84b9642e9c3f25b1', 'request_id': 'req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.573053 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] The token cache is being invalidate because project 28e3def0fcef4ccc84b9642e9c3f25b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:34:25.573371 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.574029 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.575577 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1449/2886] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:34:25 2022] DELETE /identity/v3/projects/28e3def0fcef4ccc84b9642e9c3f25b1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:34:25.579772 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:34:25.582067 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:34:25.596962 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4bcc2-bca1-412a-9eab-d7ce9ab23740 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:34:25.656903 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:34:25.663378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:34:25.663378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:34:25.663378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] PATH_INFO: `/v3/users/8cb80b7dc1704893a04ac94f859b3ad5` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:34:25.663378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb80b7dc1704893a04ac94f859b3ad5)` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:34:25.663378 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:34:25.828283 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb80b7dc1704893a04ac94f859b3ad5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.828920 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb80b7dc1704893a04ac94f859b3ad5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.841439 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb80b7dc1704893a04ac94f859b3ad5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.842861 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb80b7dc1704893a04ac94f859b3ad5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.855431 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.notifications [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb80b7dc1704893a04ac94f859b3ad5'} {{(pid=79636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:25.944870 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1438/2887] 10.222.0.87 () {58 vars in 1223 bytes} [Wed Feb 16 18:34:25 2022] DELETE /identity/v3/users/8cb80b7dc1704893a04ac94f859b3ad5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:34:26.209713 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Authenticating user token {{(pid=79635) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:34:26.212792 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.fernet_utils [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79635) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:34:26.231535 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4510fe-6bd2-456b-b6b0-f62d7d7788a8 admin admin] Validating token access rules against request {{(pid=79635) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:34:26.291111 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0166f6ee734994acd210881999ef69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbda6004e23b4962aaf44dfcd57b21b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79635) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:34:26.292007 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:34:26.292291 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:34:26.292566 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] PATH_INFO: `/v3/projects/50d013cd851344b8a35aad4978d26a3f` {{(pid=79635) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:34:26.293763 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d013cd851344b8a35aad4978d26a3f)` {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:34:26.295738 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] RBAC: Authorization granted {{(pid=79635) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:34:26.390956 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d013cd851344b8a35aad4978d26a3f', 'request_id': 'req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:26.447495 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d013cd851344b8a35aad4978d26a3f', 'request_id': 'req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:26.457902 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d013cd851344b8a35aad4978d26a3f', 'request_id': 'req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2'} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:26.475078 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] The token cache is being invalidate because project 50d013cd851344b8a35aad4978d26a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79635) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 18:34:26.475367 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:26.476033 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: DEBUG keystone.notifications [None req-fe62cfbb-f766-4c8f-bee1-655264e8a6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79635) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 18:34:26.477710 dv-cinder-773985-33-iscsi devstack@keystone.service[79635]: [pid: 79635|app: 0|req: 1450/2888] 10.222.0.87 () {58 vars in 1232 bytes} [Wed Feb 16 18:34:26 2022] DELETE /identity/v3/projects/50d013cd851344b8a35aad4978d26a3f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 18:38:23.270151 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Authenticating user token {{(pid=79636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 18:38:23.272462 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:38:23.357480 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789184d8-a92f-4beb-8fa6-bd7bdfb93fc1 admin admin] Validating token access rules against request {{(pid=79636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 18:38:23.426815 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008ddb8-9100-458b-88b0-2c399a5868a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b08679e2a634bf08a279b6d8a9ffc46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578059b701674f41b39442d2a018b489', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 18:38:23.427799 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ddb8-9100-458b-88b0-2c399a5868a1 service placement] REQUEST_METHOD: `GET` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 18:38:23.428263 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ddb8-9100-458b-88b0-2c399a5868a1 service placement] SCRIPT_NAME: `/identity` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 18:38:23.428660 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ddb8-9100-458b-88b0-2c399a5868a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 18:38:23.431334 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.fernet_utils [None req-0008ddb8-9100-458b-88b0-2c399a5868a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 18:38:23.449191 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008ddb8-9100-458b-88b0-2c399a5868a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 18:38:23.450780 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008ddb8-9100-458b-88b0-2c399a5868a1 service placement] RBAC: Authorization granted {{(pid=79636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 18:38:23.463530 dv-cinder-773985-33-iscsi devstack@keystone.service[79636]: [pid: 79636|app: 0|req: 1439/2889] 10.222.0.87 () {60 vars in 1365 bytes} [Wed Feb 16 18:38:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)